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PREFACE 

Kjch yeat. for the past tour years, ihe Austrahan Science Hducation Research 
AssocuHUMK has been abie to claim "a tusi \ In the Association held its first 

annual c< ^icicncc . m ^^7] us !usi publication appeared; in 1^)72, the proceedings x>i the 
annual conieience appealed m a new hnniai. and, this year we had our first intcrnattonal 
visitors who coninb'ued to our annual coufcTence U is probably signilicant, too. that 
the dUnuaJ meeting decided to change the n;irne of the piosent publication. 

Siuntt hJmju^^fi HcsL'unh I'JTJ rcptesenis another sigmhcant step forward 
\\w AuMiahan Science Hducatiim Research AsM>ciation. Not only is the pubhcation 
a largi v iMie than the previous issues oi Rvscarch 19V and Resainh 1972 indicating 
an increase in research activity but. it contains repi>ns covering a wider range of issues 
m NCience education, and a special section dealing with research techniques. This last 
mentioned section was included in the conference with the express objective U) develop 
our own understandings of some techniques which can be of great assistance to the 
science educaiuni researcher. 

For convenience of presentation the papers have been grouped under headings, 
or themes. Although the responsibility for the groupings must again rest with the editor, 
it did seem that clusters felL quite naturally, under the several headings. One of these was 
the Analyses i>f Curricula and the four papers related to this theme indicate a new area of 
research activity for Australian science educationists, 

Stiente Education : Research 1973, though still a modest publication, is ample 
evidence of an increase in the number and quaHty of research projects in Australia, It 
demonstrates too, that we have international interests and ties. If the nature and quality 
of the papers contained in this pubhcation are any guide, the future for science education 
research in Australia, U>oks brighter, if more challenging, than 5ver before. 

/?, P. Fisher 

University of Queensland 



PART I 

NATIONAL AND INTERNATIONAL ISSUES 
IN SCIENCE EDUCATION 




A NATIOMAL APPROACH TO SCIENCE 
EDUCATION RESEARCH 



vaihuuil lONcauh wiih j\niKulai tcKMCiuo lo NCioikc educauon m AuNttaUa, An examm- 
.iXhn^ o\ tins iianwwoik nia> enable us lo identity atea^ where moie leseaKh is indicated, 
llus appr^a^^h ma\ assist is ^> a,Nsign pu'uujes a!id lanoualisc oui himted lesvnirr 
and ;na\ k\id h» iho de\ei^ ♦i>nkMU <il\oiipcian\e iiaUonal prnjecis 

In advaj^e nun I Na> thai \\ is noi ca\\ ine 1^ disunjiinsh pocnliai ehaiacter- 
i>nvs M s^uMKC v\i !v an. Mi Nopaiate iiom cdiKaii^Mi geneialK . Wc aie .<insianily awaie lhat 
t duvan^^n 1n ^ :-rplo\ rn.iiUM . and tlie pu^bietns and a»."ii\ines «M science educalion a*e 
vaueln up iii ilu» ^ ^.njMcxnx 

Ma\ 1 » liic dennuhMi an educaiuMud !c^eauh \vv>ikei unphcd in 

:c:::ajk» a ^ •^^.id P. jiuludi^v an\ mjc u^nle vtafMK'a! pnvi\iu!0\ to make si^ne 

Nc; w vd;Kai^.^:..ii I CNaJuple. w m Jade^ pe^^plo in 1 diuaJUMi DepaitnKMUs 

a:;.i!> cnh^i:nvn!N» vUiiK uluni devol'^peis anaK suij! losulrs gailieicd dunngirial testing, 

OK 

1 suppose ii,,it. as pail these nur\Mucloj\ leniaiks. 1 should aiso detine edu- 
vMUon, hut will laijieK ahduate this task. Sunwe n to say that educatiiin is concerned 
with both *he .^'gruine and n^ rbco^mine devclnpnieni of people. 1 will be linnting niy 
comnienis lo i;nnial cMucaiion m pinnatx and sccondar) sclun)1s, leaving the tertiary sector 
it» soho Hs own jMobleniN 

The needs of students 

1 decided lo develop a Uainewink loi !>cience education r seaich based 4)11 needs. 
The basic needN aie iliosc oi tiie suidents ot science. 

I KYaid n as saluian and non-uivial to atfnni that teachers, sciiools. lidiicalion 
3>epaitnuMUs and even scJciiLe educalion joearciiers do not exist or w<Mk lor iheu ow\ 
sakes. but in a service i<^le to help to meet liie legitimate needs M the students. That is why 
1 clionse to legaid llie Heed> 0I the students as basic to my IramewiMk, 

("micntlv . tlie main needN oi the students are perceived to be cognitive. Politicians 
recognise ihi^ s;nce education s\ stems are iunded to increase the knowledge (and employ- 
ability ) ot tlic students. ParentN recognise this they ask ilien children ^mat did you learn 
toda\ " ni>t ^^What new attitude was mculcated in you today ^\ Sometimes, even the students 
rec4)gnise that iltey are at school to learn! 

1 will tlKMClore concentrate mainly on students cognitive needs, not forgetting 
lhat there are mieraciions with many non-cognitive factors as well. 
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Hk' main qucMjons 1 pusc, and attempt to answvi ate 

*\Vh.u au* the students' co^nnue needs. especuiHy m sctenee 

•How .ue the> henig met at pTesent'^* 

'Whjt leseareh ismdicated to improve the situation 

l et UN assume that students accept tliat ttiey are studying science at school in oidet 
lo leatn We iheiefore assume thai they ihusi altei science knowk\'ge and undei standing. 
Then basic need 5s have iheii ihtrvi jdequaieiy quenched. They \.4.sii iu iiave saiislymg 
icainmgexpctu nces xvhich aie relevant to tiieu inteHectual develiipmcnt and to tiieir hfe in 
the lat|:ei societv hcvond the school 

The need of suidenis to know what they know 

One need ot" the studenis is to kiiiiw what they know\ They need io develop a trame 
leieiejicc loi ilieii ieannng experiences. If Uiey liave heen siudviuga Cimcept ihey need 
to know the extent to wliich they liave learnt 

1 hev need io kniiw what the\ know ni both relative and absolute terms, hi lelative 
icnuN wc Jie deahnji with normative ovalujiUHi. The science siudeni needs io know flow he 
compares wnh 3ns colleagues. This is especially impoitant where selection procedure^ exist 
\\ Inch aie based on acluevenienl, tor exairple. matriculation results as a basis for entry* to 
tertur\ studies, ni school-awarded certiticates as a basis tor employment. 

At this point I Will not discuss the desirability of this competitive thrust in the school 
and socieiv . but note tliat it exists and that one of the students perceived needs is to be 
equipped to play the gome according ti> current rules. 

tven in a ci>operativc atmosphere, such as individuali/.ed mathematics and reading 
pn>grams at primary school, some students still act competitively and often enjoy doing so. 
Learnnn' ihei>ry telU us that mild anxiety facUnates learning. 

Students need S4)mc normative evaluation. This indicate.^ a need for some standardised 
tests with normative data. I suggest that tlie range of achievem-.m! tests in science, properly 
constructed and luirmed for Austraha, Ci>uld be increased. Much of the construction could be 
done at Unal levels, with perhaps national coordination to avoid unnecessary duplication of 
eftoir. if national norms are needed, this requires a national project. 

Of more importance than normative evaluation is meeting the studcnt*s need to know 
w hat he knows in absolute terms. This leads us to the idea of mastery learning. In essence 
tile learning theory behind the idea is that most siudentscan learn most topics given adequate 
instructuni and adequate time. These ideas are summarized in BUkR ( 197 1 ) and expounded 
in Bloom, Hastings and Madaus (1971 ). 

The best simple statement I know about the value of mastery learning is implied by 
ihe anaUigy between achievement and pregnancy given by Coffman < 1969). and which I 
paraphrase achievement is a tangible prinJuct. the achiever has some choice in the activity. 

Q the aclnever has immediate knowledge of results, the evalualitm is made by the achiever, and 

JC 'he judgment is absolute not relative. 



admnMsicted and vHMtcctcd, ot a nuxtuio ot both lypcs. The cunc^n>ndmg tc^^cafch need 
IS Un ihe dexelopmont ol nu«> cuincuiuin uiuts and asMKiated masleiy icMs based m 
mastery Icatnin^ tdvas. 

Ai tbe vinu' tnue Uicic is a need n^aNieu u^mji loi use wiUnn cinrcnt school 
LoniexiN 1 hese teNts will usuaHy have diagnostic and lemcdial aspects also. 

I think iha! \\ w\ndd be diftwuh to otganise ot dnett thij^ rcseaich nationally, 
Miice I >\uuld ospecl nian> ^pivntaneous etforts. often Ironi unexpected places. It is desir- 
able that inininianon aboiu these units and tesis, at ;he planning, development and prw 
ductum Mages, be widely disseminaied li would he valuable il the persons TCsponsiblc io^ 
tlie munmatit>n dii^senunatiini could also conduct a survey intti ilie nature ol elieciive intro- 
duction ol these mnuvatue ideas. 

I he ?Kcd ^^1 students to kmw wliat they know , especially in the mastery sense, is 
also vci> unpottaiM lor then tion-cognitive development. A student's image ot himself or 
herself as a peis^^i^ ^selt esieem, selt conccpi ) depends m pan on achievement, 'The research 
findings levcal a vlear. perhaps causal. reJaiioUNhip between a student^ academic peilorm- 
aiKoand p!ogio>s and h\^\h hn scU voiwirpl and Ins mental heahh. " < Block, 1^)7 K 
iiiven the complexity ot today's and tominit^w's vKieiy, the school has an i>bhgation to make 
as large j contMbutn>n as n can ti>wards developing a positive self-image iti students so that 
they can ct>pe adcvjuaieU wnli these complexines. 

The need of students to learn efficicnlly 

The next student need is w learn elliciently . Teaching is both an art and a science. 
I hesitate to comment on the artistry ol teaching. The science of teaching is a different 
matter, 1 see it as a con elate of his profession Jism that a teacher should be a master of what 
IS known ;jbout the science or technology of teaching, "It is obvious thai the effectiveness 
of teaching is directly related to the stale of knowledge about the learning process and the 
teacher s effectiveness in applying it/' ^Rowlands. 1%7. p,l5) Or simply; ''Many science 
teachers teach poiuly because of their limited Ciinccption of how learning lakes place/' 
<Balson. 1^73. p.S) 

Learning theory is complex but there are certain general ideas for which tlicre is 
enough cmpnical evidence to regard the ideas as laws of learning. 

On this matter a recent paper by Bloom (1972) is relevant. He says that many 
educators complain that nothing is really known about the educative process and boast about 
their innocenixv 

BKn^m maintains that there have been advances in our understanding of education 
and related phenomena. These new insights represent loss of innocence: , . the burden 
of responsibility for appropriate actions and practices rests with the professionals in the 
field once new ideas are adequately communicalcd.*' (Bloom, 1972, p.349) 



Q So my suggestions for research in this area fi>cus on the need to implement effect- 
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\cK \u witMue cluNMouuis oi AuMiaha v\hat is alicady known ol ihe science o1 icacti- 
n^. An m nn pH*viou?i seciUMu 1 pre^^s !»n the stud> o| NUaicgtcs oi change in aiuuides, 
hanjie ;n icacner hchavunn, eu\ 

1 heie aie iw\> areas ^heii i .ee dial more nUoimatuMi is needed !t> help iho 
Uidcnt to leatn nioie e!!iaeniK\ 

Without wishing to espouse an> paiticului model, it seems obvious that the nune 
\e kitow about learning hieiauhies, and the mote actual hictarclues we mvesngate and 
on^!!uct withm a science topic, then the nune einciently we can help students to learn 
he topic 

ihiN leseaich level lends usell \\> national coordination hnked to a great deal of 
o^al .Kti\it\ In paiticulai. at the national level key conceptual ideas and nn^dels could be 
A oikod o:ai , complete with hteraturC surveys, etc, Basic reseaicli methodoU>gies could be 
icxclopod at t!ie national level and published as in a technical rcp\nt handbook form. 
Ahich could he used by an aiert science classroom teacher X\) prepare and test a hierarchy in 
i hunted atea of interest 

1 he othci area lo! woik \m Icarmug elticiency is Al 1 (apliiude-tTeatnicni inter- 
acnon ) Hie term is biuiowed from Tronbach and Snow ( 1^)6^>), In other words, which 
aeatments tteaching methi>ds, etc.) are best for which students tor which curncuhnn topics 
H^der which condnlon^. Under treatniem I include llie range of audio-visual media also, 

! think we need to tackle much more systematically the question of how to assist 
the student lo accomplish effectively and satisfactorily the components of his curriculum. 

1 have been upset for several years by the sight of thousands of teachers re inventing 
wheels, and the energy thus dissipated which could be spent more usefully. By this I mean 
ihai a teacher i^ften prepares his own set of notes, examples, tests, assignments, teaching 
iids. etc. in isolatum from the etfiuts of his colleagues in the same scliool and elsewhere. 

1 am not advocating that the pendulum should swing the other w;iy with all 
teachers using standardised packages. Nur would 1 wish to restrict the professional respons- 
ibility of the teacher to tailor his offerring to the perceived learning needs of his students. 
But if a carefully prepared set of materials is shown to be effective in helping students to 
learn a given t^^pic it seems that the onus with the teacher to demonstrate that the 
students learning needs are met better by the teacher^s idiosyncratic approach than by the 
prepared curriculum materials. 

If each science teacher tries to be all thing to all men' then his expertise will be 
spread thinly. It seems to me that he would be better advised to concentrate his expertise 
on a particular topic, contribute the results to a 'pool\ and draw f'eely on the rest of the 
•poor for his other topic requirements. There are also important attitude changes for the 
teacher associated with this 'contributory openness* as compared to 'idiosyncratic self* 
sufficiency'. 
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Under this secnon I should include large scale curriculum materials development 
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\n a loinul , ihc lUcas \ luixo heiMi Mating ahoul coopctalivc dcvclupinciU of 

\ ihivon^ii cxdluation o\ ASl P ts needed. U ^h^K as an accouniahihiy exercise, 
hc\auNc lu^^' N.^n;N oi jv.jblK nione\ ha\o been speni \n Austialui on ihis innovalivc 

WjUhhu dennmg what could he coveicd by ihe evaluatuit^ of ASFP. n 
mipoiuini io ctnitdnute ihc acuvmes nanonaHy while cncourajin)^' local rescaT* h Jiiudies. 

The need «f ^ludenis !o have iheir que\iit)iis answered 

Anothei need a science Mudcni 5s lo haw his quesluMus adequately answered by 
his teailuM 

At *Mie ]e\el this nieans thai ihe science icacher must be competent in his own 
knowledge ,nid undcistandnig oi scieike. Here is a lesearch question: 'How much compet- 
ence m science is enough loi wind* students?' 

Ihe student s questions may ansc trom withm a lormal curriculum, from within 
a genera! studies nvfonnal priiblem-iHieniated cuinculurn, or from within a student's out- 
ot-schoul experience. 

It is a need <ot reasonable expectation) of the student thai the teacher should be 
able to answer such questions. The answer may be a direct factual answer, as if the student 
liad asked the ngl ^ scientist or opened the right page in a book. 

However th'* teacher is employed as a teacher not as an encyclopedia. The answer- 
ing of the question may be related more to the managerial riile of the teacher. 

I regard a science teacher primarily as a manager of learning experiences in science, 
not as a scientist. I have not heard of any researc!i in Australia on task analyses of science 
teachers. Here is another set i^f research questions: "What types of t*^sks fill the science 
teacher s day (and the working part of his night?) What are the relative proportions of these 
tasks * Which of these tasks are associated in which ways with effective and satisfactory 
student learning experiences *' 'How should the teaching behaviour of the science teachers 
be mixlified toimprtwe student learning?' 

May I digress lo explain what I mean by teacher behaviour modification, based on 
a visit I made to an individualized mathematics instruction project in Pittsburgh (IPI : 
Individually Prescribed Instruction). The teachers in the scheme were free to deal with the 
problems of individual students while the rest of the class proceeded with their own work. 
The researchers liad noted that the teachers tended to spend several minutes with each en- 
quiring individual, which meant that only a few students met the teacher each day. As a 
corollary there were some timid students who hardly ever spoke with the teacher. 
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The researchers were in the process of training the teachers not to spend much 
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Uiuc With e.Kh siudenr Ihc teachei was bein^ nauicd lo lead ihe Mudcni the next step 
only, ihtowing the onus on the student to pick up the leanung iioni ihero. Ihe icacliers 
wcic also trained to make some work^elat^d coniaci wul^ each suidem m the clas^each 
peiiod- 

LtM nie also mention some siudeni behaviour modification In^m the v. me jitojeci* 
Aner each section the students did a test and took it to the clerical assistant to he niaiked, 
vvltjch took som^ time. So the smarter students took tests premaiureK . and s j* » iu ed 
them to marking. Of course the tests were returned as unsatisfactiny. The re t si r >'-mark/ 
re»!est, re-mark/ etc, cycle was a long one with plenty of rest petiods nn the s' a-.entsl 

This brief comment on teacher-student contact provides an iiuriiductioi lo the 
imporiani rteld of teacher-student inieraciions. The key research questtons are: What are 
the relationships between personality and behaviour characteristics ti! science teachers and 
effective student learning?^ *How may teachers" behaviour he modirted. enlier preserviceor 
luservice. to maximise the development of ihe desirable characteristics and to ehnnnate 
undesirable vMies?' The survey by Rosenshine ( 197 1 ) is a valuable introduction to this area 
of study. 

I will turn to a particular aspect of teacher-student interaction. 1 said earlier that 
a iteed o{ the science student u that the teacher should answer his questions. 

You will be aware that questions may be asked on several levels. So far 1 have 
dealt with questions taken at face value. The student thirsts for knowledge and the teacher 
meets tlie need- 
Often a question has a deeper meaning. The words of a question of a primary 
student may say: *Why does electricity turn a motor?' The real question beyond the words 
may ask: *Are there strange forces which really run this world?* Or it may ask: 'Are you 
a matuie person with whom I, as a growing person, can establish a meaningful relationship 
that will help me to grow up and understand this complex world?' 

A young adolescent may ask: *What are the effects of smoking cigarettes?' Hic 
latent question may ask: 'How do I make decisions about my life-style which are both 
rational and satisfying?* 

The science teacher has two responsibilities with respeci to these questions. First- 
ly he has a responsibility as a teacher to be sensitive enough to his studei..i to hear the 
real question, which may be the latent one. Secondly he has a responsibility as a teacher 
to attempt an answer. As I said earlier, one of the legitimate needs of the s.udents is to 
obtain answers to their questions. 

To my mind this area of teacher sensitivity is very important. Research in the 
area will also require great sensitivity. The research questions are: ^How can we identify, 
categorise and measure teacher-student sensitivity situations?' 'How can we select 
teachers with the ability to deal adequately with these situations?* *How can we modify 
the behaviour of all teachers to ensure that ;hey have a minimum level of adequacy in 
O sensitivitv situations?' 'What is meant by dealing adequately with a sensitivity situation?* 
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The need of students for career guidance 

1 \\\\\ briefly commcm on aiunher area o! Mudont needs. 

Siudents express Jheir need to obtain a >>od job^ ai die end of iheir schooling. 
Tliey and then parents exjxvt an apptiipnate cerlilkate when the students leave school. 
This xine then uteeds, 

I'nlortunately ihe^e is often dissonance between student, parent and teacher 
altitudes on tins future career aspect of the work of the school. 

At ACl R 1 am working i)n a follow-up study, in which we collected information 
ui l^^ll \u>m the Kvyear-olds who were members of our 1970 sample of 14-year-oIds 
^Population 111 

The suideius were askeu how important it was to their teachers, their parents 
and themselves thai they got good results in tests and exams. 

The daia frotn our pWox study indicate considerable dissonance. 

Table 1 Importance of good results in tests and exams 





Not at all 
important 


Slightly 
important 

7, 


Fairly 
important 

% 


Very 
important 

% 


To your teachers 
To your parents 
To yourself 


19 
I 
1 


26 
1 
1 


36 
12 


19 
76 
86 


(Number of student*; 


= 194) 









A similar question inquired into the press upon students to make career 



decisions. 



Table 2 Importance of deciding future occupation by 



ths end of the yeir 




Not 


Slight 


Fair 


Very 


To your teachers 
To your parents 
To yourself 


47 
11 
11 


29 
U 
5 


14 

31 

22 


10 
47 
62 



(Number * f Students- 190) 

For further insight into this need, let us recognise the changing nature of the 
secondary school population. The retentivity has increased markedly. Students now see 
secondary education as a right. Only a few decades ago it was a privilege. The incr ^ing 
O number of secondary and tertiary students leads to the idea of the 'mass elite' (Bowriian, 

ERIC 

1970). 
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IwiU^ujunu wiuingiiig iclcnUNUN picuiivhx siippKing mmik" daui \\c 
cx^lkvtCvi UN part ol thv* IF A Sokmkc Pu\kvj, 1 detuK reicninnx as ilic pu^ponu^n ihv 
>jgo C\Mion \\ju^ aio ai sOwondan school. 



Table 3 Retentivity of Australian students i 1 1950. 1960. 1970 



NSW \k Old SA \\A Tas Aus 



lt>-NCai-o]dN 





37 




28 


34 


30 


4^) 


35 






^0 


57 


t: 


52 


71 


57 


\<m 


M 


Sd 


71 


S4 


71 


83 


H\ 




15 


lb 


13 


14 


1« 


17 


lb 




:b 


32 


29 


34 


2to 


30 


2^ 


h)70 


52 


62 


3(1 


57 


3b 


43 


51 


J^)50 


<■> 


t> 


5 


5 


5 


7 


b 






12 


13 


1 1 


13 


1 1 


n 


!^)70 


31 


33 


1« 


25 


IK 


20 


28 



Source U\.\ Age-i;radc lahlcs nicoipoiaTnig variiHis csiiiuaics. 



It IS an impoilant researcti problem thai we investigate how t- change the 
aitmides and behaviour o\ M the parties m the educational enterprise teachers, students 
and parents in a way that rationalises their expectations and avoids the dissonance which 
currently interferes with the elYecHveness of the enterprise. 

Yi>u will notice in my last tew statements 1 have consciously advocated changing 
teacher behaviour, 1 beheve this t*^ be consistent with my earlier statements that there is 
a science or technology of teaching, albeit immature, of which the professional science 
teacher is obliged to be a master. 
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This leads me to comment that those with a responsib'Hty help train teachers, 
that IS, to change teacher behaviour, also have a responsibility to carry out follow-up 
analyses of their trainees. Tins research procedure will be informal for most teacher edu- 
cators, and will become an important research exercise for some. The nett result will be 
the development of feedback-type models where training techniques, etc. are moditied as a 
result of observing the behaviour of the trainees. 

Up until now 1 have mainly dealt with achievement, and also mentioned various 
non-C4>gniiive learning outcomes. It may be possible to deal with aspects such as sensitivity 
or self-esteem as isolated factors, for example, in preparing measuring instruments. It is 
not possible to identify useful relationships at this simple level. 

As I keep saying, education is very complex, and valid simple relationships do not 
4>ccur. Most studies of factors effecting achievement will be complex, and this implies 
careful samples and multivariate analyses. The recent book by Keeves (1972) provides 
an example of the statistical treatment of the kind of complex educational relationships 
9/- J am talking about. 
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I he needs «f science teachers 

You will iccall iliai \ decided to adopt a traincwork of iieeds lo ideiuify possible 
Noencc cduvautMi leseatvii activuics. 

let tunu in loi^s detail than tor siudeni needs. U) the needs of science teachers. 

An slhnvn In Au>iiaiian results inm the il.A Science Project, most science teachers 
feel the need foi lefieshci cr^uise> m science. < Rosier, 1^)73) 

The\ icel tlie need boih tor courses in science itself and in science teaching methods, 
rheic aic miuaihMiN that tho\ could ^how more mttiative and exen mor*^ effort themselves 
im ihen proiCNMonai vle\elopment, 

\ would like to see some researcli on strategies to inspire teachers to improve their 
ptotesMona! competence. Is it a mixture of certillcation carrot and salary stick? If so. 
what is the lecipe * 

One approach I have seen is that developed by the US National Science Teachers 
ANSociation ( pri)) They prepared ASIST Annua! Siif-imiWory Jhr science teachers. 
ThiN in turn tollowed tiom work in scltmg up a statement: ConJifionsfori^ood science 
ieacinni: tn sicomian schnUs. (NSTA, I^^IO) 

Members of NSTA wishing to participate in the exercise complete their ASIST 
form, tach respondent's data is incorporated into summary data. The respondent receives 
a copy of Ins own lesuiis and the summary results. He can compare himself against his 
peers, and presumably act on areas where his behaviour is different from the behaviour of 
many colleagues. 

A similar idea is being developed for dentists (Educational Testing Service, 1973). 

Lach participating dentist subscribes (for a S40 annual fee) to a series of self- 
administered exams at 3'month intervals. Test results are confidential, and are sent only to 
the individual dentist. He also receives summary information to indicate his standing 
relative to his peers. 

Teachers express a need for good conditions. These conditions are not all needed 
to an equal extent. The key conditions are those needed for effective student learning. 
There are other conditions which are necessary (or desirable?) for teacher morale. As with 
poverty, 1 suspect that d^'finitions of adequacy are relative, but there is need for careful 
research to establish a statement about adequate conditions for science teaching to replace 
arbitrary political-type statements of class size, room size, number of teaching periods, etc. 

The needs of the system overall 

I have defined the final set of needs as system needs. By system I refer mainly to 
a national or siai»^ system of schools, but some comments apply to the individual school 
as a system. 

O 

ERIC 



i: 



Whcij \ >j\ I he \\MLMn iuiMKvds I am icaih sj>nii: ihai the poUiu ians \\hi> >upph 
Uk* Umds toi cducaii\)n liavc ccitain needs whwh muNt be niei u iho\ aic obuun and 
di>tnhme tunds etieenvely, Thcii basic need js to know how onectixoK ihc nuuiey t)ie\ 
punide is bemji used to purdiaNe emaent learning cxpenonces loi ihc Mudonts in liio 
sNsteni. 

One uppToacb is u> v<>uni \hc nunihei tedeiwjN and NUidoiUs, and >j> \m\ 
because iheie aie \ leaciicis contionting ^^udeJU^ daiK . tlieieioie ieaminj: nuist be 
occiUThig. 

A njoie onipuieal approach is lo nieaMUe the exicnt \o whwh ihc amis of the 
s\Mem are mei. 1 his is duticult snicc Ausiiahan education N\Meni> do noi articulate dieu 
amis. It the baMC aim is student achievement, as 1 inieircd at the be^innmi: my paper, 
the ?»\stem should be evaluated on the basis ot" the achievement \y\ tiie ^tudent> 

TJie achievement measured .should not be an \ibsoUue' achievement but one / 
adiu>ied tor whaiactenstics of \Uc students in ilie svstem. especially home backiiround 
charactensiics 

Sssiem evaluation lequiics iaue scale studiCN. aithouuh theie aie dangers such as 
!h\iNO pointed out by Orlans { l^>7: He slates that othei rescarclieis can challenize the 
findings a small studv ,by lephcating it. A large study cannot be replicated; the data 
aie unique, and can onlv be ciulienged on the basis o1 internal weaknesses which are not 
tM cannot be concealed. 

One iaiiie scale system evaluation study is \Al:P (Natitnial Assessment of 
l-ducaiumal Pi ogress ). 

The NAtP science project started by preparing a set of aims in science for 
year-olds. L^-vear-i)lds. 1 7 year-oids and young adults. (National Assessment of Education- 
al ProgresN. I'H^^)). They then piepared \\\ercises" (that is. items) to les: these aims, 

Tlie iuilv scores presetiied are the percentages of students correctly answering 
exercises. The exercise scores are ni)t combined into test scores as we know ilieni. 

Their first results, now published (National Assessment of tducational Progress, 
1^>7()| show the percentages of students achieving mastery of various objectives. Sub-groups 
aie also investigated for example* divided by sex, race and geographical location, 

\AtP is a type of large scale mastery learning evaluation at the system level. 

If the \ AhP results are regarded as norms, an individual group such as a school 
bi)ard can test its own students against the NAtP norms to evaluate its cognitive perform- 
ance as an educational sysiem. 

Should Australia carry out a national evaluation of science education based on the 
NAtPmodel'^ 
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Ihc o\hc\ t\pc oi s\\KMn c\aluauon Uilunncs mote on the reasons tor achieve- 
nicnt. This ihe nadition ot ihc 1 oicman Report U olenian and othi?rs, W6b) the 
Plowdcn Repoti « cniiai Advisory Council for Education. 1^67) and the IE A Mathematics 
and SvKMKV Repoiis \Husen. \^H^7\ t oniber and Kceves. 1^73). 

These large scale studies ottei the \)pporiunity tor analyses between schools as 
well as between students, as demonsnated m Rosier U973). 

These studies ot a 4>pe which 1 describe as ^achievement and its correlates' studies 
also lend themselves to a normative use» 

\n\ Nchool would be able aditiintster the test instruments to a sample of 
studems, tcawhers and parents m its own school. Its results could then be compared with 
naiiiMtal oi regumal nonns, Tl^e scliool could compare its achievement with other schools 
m absolute terms. Preferably it would compare adjusted achievement scores; that is, 
achievement scoies adjusted for various student, teacher and parent characteristic^. 

Since ihe analyses are con^plex, any self-auditing school would have to send its 
lest and questionnaire data to the 'project headquarters' for processing, and return to the 

This means that the project headquarters would be able to continually update and 
expand its data base. 

Another 'spin-off advantage is that it would be possible to identify deviant schools 
schools whose adjusted achievement scores are rather higlier or lower than expected, A 
special research study of these schools could produce very useful findings. 

Large studies can also offer "piggy-back' facilities. An isolated researcher can add 
his question or lest to the main testing program. He does not have to worry about the 
organisation of sampling or data processing, and yet he will have access to all the other test 
and questionnaire data collected by the main survey to link with his own questions. 

It is very difficult to estimate levels of national achievement from a single survey. 
Repeat surveys, or the 'rolling' survey ! have just mentioned, are necessary to gauge 
whether national achievement levels have changed or are changing. 

Related to repeat surveys are longitudinal surveys, in which the same students arc 
followed for several years, A classical example is given in Hus/n and Boalt (1967) where 
students were first tested in 1938 and were subsequently contacted and retested on various 
occasions. 

The advantage of a longitudinal study is that j^ersons can be studied over time to 
trace their cognitive and non-cognitive development, and their career paths. 

This is an attractive idea for a national science education research project since 
many aspects of science education could be tested and their consequences investigated and 
^ "Evaluated over a longer term than is usually possible, 
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Conclusion 

In conclusion ma\ 1 summarise. Theio aie cor!;un laiue scale s< leiue t:dticaUon 
leseaich jnojects which lequne a team oriesearcheis. The si/e ot iho team wii! l>e 
:eiatneK lai\;ebv piovituis Austiahan educatuMial leseaicl^ Ntandaids, These studies ni 
ihe nafiojial science achievement exaUkition u pe tequne Npecial expertise in ,>amphni: and 
data liandiing. 

On ihe other hand there are many science education research activmes which 
lend themselves to cecentralised daia collection and analyses. The gieat need at the 
national level is loi Ci>oidinatu>n. This coi idination may involve nune than sunplv 
swappmji mioniiaiion about projects planned, under way or completed. 

In many cases the C(n>rdmaim^ person or ceniie will he responsible tor con- 
ceptualiMnji the problems so thai a useful f ramework can be developed within which 
mtv^rmaih^n tiausKM can t>perate ellectivelx . 

I wtHild like the coordinator to take the coordinatiim f unction lurther and 
piepaie handboi>ks ti> asssisl the cooperating researchers> 1 assume the person or centre 
v\ould bo JdequaieK landed bA>ih to dev<Me time to these activities, and also to make 
tleld visits to discuss lival activities with the ct^operatinj: researchers. 

And 1 suppose this leads lo a coordinator ot coordinators of science eduLaiion 
research activities, so that all interested persons can be kept well informed. 

I realise, at the end ot my paper, that 1 have not mentioned priorities except to 
maintain tliat student needs should be our central concern. 

Anv list we prepare will change over time. I will leave it to the Australian Science 
Education Research Association to start to prepare its list of priorities. 
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THE INTERDISCIPLINARY APPROACHES TO CHEMISTRY «AC) 
PROGRAM AND RELATED RESEARCH 



The stage lias been set nwely lor n\\ presentation by earlier presentanons which 
pomi out m \hc\i content analysis oJ (HI M Study thai it represented a strong pendulum 
swing to the research-based theorexical and quaniaiive sides ot chemistry and away from the 
application side that !iad become so pronnnent in the two decades from 1^40 to I960, Now. 
early in the 1^)70^, chemistry teachers in the United States have recognized that while CHEM 
Study leprcNcnis an impiHiant advance m chemical education, it was designed for the 
hmited numbet i>f students who clearly have science or engineering career goals in mind. 
The much larger audience ol students who need and want to study chemistry for general 
education purposes are not satisfied by CHHM Study with their chief complaint being that 
a IS not relevant lo then interests and needs. Enrolments in high school chemistry are 
dcchning. Student and teacher alike seem to be searching for an alternative prcgrammc that 
will appeal to the large student population interested in studying chemistry for scientific 
literacy purpv>ses. 



The LA C. Instructional Materials 

Hence, the advent of 1AC\ the Interdisciplinary approaches to Chemistry programme 
developed by higli school teachers and chemistry professors who have worked closely 
together at the University of Maryland' . The lAC programme presently consists of a series 
of seven interchangeable instructional modules: Rtwiiomand Reasi}n, an Introductory 
Module: Form and Functiopi an Organic Chemistry module; Diversity and Periodicity, an 
hiorganic Chemistry module; The Delicate Balance, an environmental Chemistry module; 
Tlie Heart of Matter^ a nu-lcar Chi^mistry module; Communities of Molecules, a physical 
Chemistry nUHlule; aod MoUcvle:^ in Living Systems, a biochemistry module. Four additional 
modules on consumer chemistr \ geochemistry, chemical calculations, and the chemical 
cycles of the earth are under development. An extensive lai^oratory programme of mini- 
experiments and experiments have been integrated directly into the student modules. 

Detailed teacher's guides for each nK>dule have been designed as a means of in- 
service education for classroom teachers. These include teaching strategics, help with 
laboratory and classroom management, a guide to self pacing and independent study, state- 
ments of major concepts and performance i*jectives (knowledge, skill and attitude) and 
evaluation items keyed to the objectives. In addition a pre-test and post-test that attempt 
to measure change in the cognitive, psychomotor and affective domains plus dual tests 
(knowledge and skill) for each module have been constructed. 

Imtnictional Charactemtics 

Field tested, in experimental editions for two years prior to publication,^ these 
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modules woic JcMgncd io convey tlie tollouuiji inMuunonal chaiacionsikA: intvi- 
iWiplnury nature, relevancy, llcxibihlv. concepi and process eniplusiN. siudeni cenued 
onentaiion. an intorniality ot st\ le and tun U was tfie nuent ot the \Ai leain lo letum 
iuan\ cuficuUun decision^^ lo ihe local school system and ihe classroom teacheu Such 
deciMOnsincJuJe. (1 ) which nu>dule^ uoeach, Cimwhat oideuand r^)\\hethei m 
Ci^nNeniional cla^isrooni group oi m a sell-paced ot :ndepondeni srudy nu^de. 

Ti^aching The 1A€ Programme 

The iniroductory nu^dule takes the longest to teach iappioxunateK eiglii weeksK 
with t>iher5» requiiuiir appioxnuately m\ weeks m the nuddle of the school \eji and cuitinj; 
hack \o tour weeks near the end the yeai lecardless ot selection ot' modules, hi addition 
lii the common use ot tout to m\ ot" the modules t\> comprise an ] 1th giade \ear-lonji 
cliemistry course, the I AC im^dulcs are llndm^ many other niches in the cuincuium. hi 
some cases tliey aie arranged to tonn a semestei course or minicourse of six to nine weeks 
duiJthMi. In otlieis. they are used to ennch a <HhMS course or a biolojiy, physics, or 
earth science programme in ilie secondary SthooU, Other schools, especially Uiose interested 
in moving toward the teachmg ol' integrated science, are proposing to use the mtioducti)ry* 
and envui>muental modules in the *^>ih giade. iUganic and biochemist! \ m lOih, inoiganic 
and ph\sical m \\w \ iih ai^d ilie nuclcai iiiodule m the ICih giadC- These uiU bo supple- 
nuMiied with instructional materials lu>m biology, pliysicsand the caith sciences lo iorm the 
!'our-ye;»i secimdary scho^^l progiamme. Comtnunity colleges t'lnd the lAC modules be 
atiiactive for then chemistry programme !or non-science students. Pan ol the excitement 
o! lAC Chemistry is its adaptivnx and, I tn ihe developers, watching it f ind its place in the 
science curriculum- 

It we are correct in some ot our basic hypotheses about science teaching and learn- 
ing, lAC Chemistry may well be an important new direction in science education. One of 
these is that a structured scope and sequence programme (the conventional textbook) is no 
more efTeciive in the learning of science than a range of interchangeable content modules. 
Another is that studenis will learn better and retain useful knowledge, skills and attitudes 
hmger if tliey enjoy what they are doing, don't feel too threatened, and see relevancy to 
thenusclves and tiie everyday world around them. Third, that it is just as important to teach 
chemistry for cultural reasons, for scientif ic literacy, as for career preparation. We believe 
that tins broad, general, interdisciplinary approach to chemistry is an adequate preparation 
lor the more specialized studies a student will encounter if they continue into university 
education and a far better preparation for the understandings of science and technology that 
they will need to live in and cope with this complex culture of the 1970 s. 

Field Testing and Feedbadc Systems 

Now, if a curriculum development group sets the goals outlined earlier in this 
paper* they must be prepared to evaluate their efforts and to encourage others to evaluate 
it as well. Formative evaluation must be a hallmark of any new curriculum project. 
Summative evaluation needs to be carefully designed as well. 

After defining the purpose (to popularize the teaching of Chemistry) and the 
instructional characteristics of I AC Chemistry (cited earlier), the development of instruct- 
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junal jnatvujlx hoii^n 1 oUown^j: jjcncial jjruvnieiu on ihc conieiU, the cxperinienis and 
mmi-e\pcunKMit^ weic dcxcloped and te^U^d hcUnc ihc «;inaUvc icxi was wrhien to ensure 
a Mudcnt-ccniiv piocianune The teedhack ?iysiem went into operation unmediately as the 
expennvniN weic lun and ciujvised hy an tn-8ei\iLe class ot about thirty experienced 
sewimdan Nviiooi le.uhcjN who nuM weekh m the e\enmg at the Vniveisity of Maiyland. 

Duuuji \hc nc\i iiunnnci ( 1^)71), chenmtty piol'essois teamed with higli school 
leaciuMs to te.Nt ieach then nu^dules to students emoHed in summer school classes in t^earby 
secondaiN s^hooK, Now . dnOLt student leedhack was combined witli teacher response to 
KMNe the Ntudem modules Dunne the summer also, the teacher^ guides were brought into 
lust draft loim witli viasNMUMU teacheis taking the lead in development. During the 1971^ 
''C school \cai . the icMscd expiMiuKMiial editions o1 the mtnlules were test taught \v twenty 
sdioiils. Those schools, icpiesentmg a lange ot uiban. suburban and rural scl ools, were 
located neai tlie \inueisiu si> iJiat teachers could meet with the \AC aulhos earn on Thursday 
exenmes m leedhack scssumis, hach test leacliei tauglit two or lluee I AC classes while the 
lomamdei his liei schedule wa^ i WlM Study or a conventional chemistry programme. 

SubivMoeh assessed, a high level ot enthusiasm tor J AC Chemistry was apparent 
m .students and tcaJuis 1 he all-nnpoitant student grapevine began to operate in the schools 
Aud vhenostu iMiioiiiienis UKieasCu ioi the suhsequeni yeai in luneiecn i^l the twenty 
Nwho*>1s» in siMue cases dianuncaiU . 

Admiitedh . some ot this must be aseobed to the novelty etiect. All ol the students 
under the direction oJ test teachers. I AC and nimT AC, w ere given tlie NSTA ACS Higli 
ScluH)! hxammatum, Suipnstngly, tlie lAC students, even thougli they had experienced a 
buuder. more niterdisciplinar\ . less quantitatively and theoretically rigorous study of 
chemistr> , had a gOi>d grasp o\ the important tacts and piineiples ol chemistry as measured 
by this national examinaiion. Siaiistically there was no dilTerence in performance on the 
NSTA-ACS test by lAC and non lAC students. Since the sample was modest (twenty teachers 
and approximately :,(H)0 students), the teachers were atypical (all known as above-average 
vlassrooni teachers with a committment to I AC) and the sample seograpliically parochial 
in location, the results ol this first content assessment could only be considered as an in- 
dicator that 1 AC students were not being seriously sliorl-chanied with respect to their know- 
ledge of chemistry. 

Related Research 

The increasing enrolments were evidence of an important attitude change and the 
knowledge performance was comforting, but it was considered necessary to try to construct 
instruments that could more precisely me;.surc changes in attitude, laboratoiy skills, know- 
ledge and the adaptabihty to self-pacing tliat we claimed. This led to a very important 
decision in curriculum development Sat a series of research studies should be designed and 
based on lAC Chemistry from its earliest stages. 

Four research studies were immediately identified. Additional studies are being 
initiated now. Hie original four were designed by four advanced doctoral students working 
under the direction of the I AC project director (Marjorie Gardner) the Director of the 
Bureau of Educational Research (James Raths)and the Chairman of the Department of 



Uculu and the SvuciKt' leavhin^ IViitci tacuiu alM^ soixcd on tliosc icscauii vonuniUi'os. 
Iwo ot liu* Mudkvs ha\c boon lOpoUod und i)io tUikM two aic Ntjll ni pu^jiivNs. Iho Una 
iiuiudc K'soafvii \Mi Ntudoiit attiuuio^ Olonn HoikkuKMU. Niudoiu iabinaioix nKiIIn < K»^bcu 
lloaiio K Niudoni know lodge o\ and ^on^opl Ulaiu liOinboihn|») and la^u>jN nuluoiKUii: 
Nludeni Muco^^ n: nidojundoiu sludv i \nuido Sandoval), The fiiNi two siiuiiON iuuo bocn 
icpoftcd and \\iU ho Minnnan/od hoio. 

Attitudie Study 

HcikknionN suidx a^NOssod iho uHanxo iniluonvo oi 1A(* and nun l.U piokMannnos 
oil the nioaMiicd attHudos^M iuxih >clun>l choinisn> MudonlN. I ho NUid\ \ •nMp»v^o^ uoio 
i1 ) lo doxcUyp an oaMl\ adnmnMOiod and >cojod attnndoMnwaid >Uid\ui^-ciionnNh> N\.alo. 
iho uvonUMUin Ijkoit svaio. Suidoni Opuuon Suivo\ in CiionnNtix iS<)S( ): {2) to v*>jnpaic 
lArxvith vtMAcntional oluMnisirx coui>o>in ilion ^apjcn\ lo dlttoionnailx altovi Niudont 
jn^Juvios i»n\.iu1 Niud\ino iiionn>!n . and \ ^) n* nnosUiiato spoalii.^ NtudeiU \aiut>loN ulnch 
nni^hi .iicouni Jor iho latiijo i>! >tudcni aiinudos i^bsoi^od alici a \oai\ oxpouonco m higl) 
NX h^td ^hoiUistiN 

IVai^i ih V ' »1 :cLilh Ml V i Hv k'lilN jiui -ill il\ nJn \.i3KnK0 UUd ».\>\ Ji KliKO U\ hniqUON 

-c^!od i.> poihosON lolaiod ti> povNjhk* iJiMUnoin i \AC tion-J AO and no\ { nialo^UMualo ) 
nnliiOJKON on >uidoni anmido^ .is nioasuiod ni Sopioniboi. Januan . and April Stopwiso 
lOl!l0^slon Jiockod ilio abihi> oi soliMod Ntiidont v.inahloN, onhor mh^Iv o! jonnh , t<i loduoe 
^ 'v* ,inbuuit til unoxplajiiod vaiunuo ,inh»ni! o!id-\ oji SOS( annudo.s, 

hn\Ui\ Jititudos o! j:nlNV\0K' sifMntkanflv Ionn LiMunablo UAvaid Uw Niiuhnigi^t 
i.honnsii\ !hjn uoto iho aimudos ot hoys. No trojtinoni oi no\ dittoroncoN woio found among 
onf)Oi nnd-Noar or end >oai SOS(' atntudo>. wiion nniial aiiiludos wert? hold 04>nsianl. hi>w- 
o\0!. Gnis in both Upos of oour!>03» achiovod Mgnil'ioanily highoi TOUS sooios ihan btn s* 
aUhough no TOl'S diJioionoo was annbutablo to troatniont. 

I rom 47 ' UAC males) \o 75' ^ ^n^ni-JAt males) of end-year SOSC* aililude vaiiancc 
viHjld be oxplanied by iho vanablcb studied- Probabjliiy ol laking more cliemisiry. enjoy- 
ment Of previous science courses, miiial attitude and expected grade acted jointly to account 
loT mi^st 4>t ihc ond-ol-oourso attitude variance. 

AltiH>ngli all sub-gn^ups expressed favourable end-year attitudes toward the study 
i)! cheniistrv . modest declines in the degree ut tavourabiUty were noted for both treatment 
and Ncx grtnips during the school year. 

Laboratory Skills Study 

Hearlc's study v^s directed toward measuring attainment of laboratory skills, a 
badly neglected area ol evaluation in the teaching oi chemistry. The study s purposes were: 
1 1 » U) ideiHily skills that are expected learnings from high school laboratory experiments 
regardless tit course: (2) to develop means of assessing both the cognitive and manipulative 
>kiHs learned primarily through laborator>' based experience: (3) to translate this into a 
multiple choice instrument that could be used nationally to compare performance in the 



sKiHn Jivav amlHHo voiupaic \M wUh uon^lAt Miidcnu and boys wiih pxhm tlieir 

I Hsi a jiiid ot cognitive o a* , ^^hserving, imcipKnmg. ptt'dicting) skills and manip- 
ulau\c OaV. weighing, mianngj j^kills wAunmon to ihc lAl M'Ul.M Siudy and Modem 
t hcnn5»ti\ pio^iannnosua^ developed, A pie tcs- and poM leM thai incorporated imvs 
believed to n:easiue each of ihe^^e j^kUK was develt^ped and levised lo a saiistaciory level ot 
\ahduy attd rehabihly. A tcachej^i:uide ot inMrueiions \\)\ setting up the practical siaiums 
was designed. The UKsirunients were given pilot runs and tested for validity {by Jmy 
technique}, lehabilnv and disciunmation characteristics isiaiistical ireatnents)as well as 
Urt logisnc problems o\ prepaiutu)n, administration and scoring. 

In >!vptenibet at the t^pennig t)t school th,e revised pieMest ot laborator>' skills was 
given to jbi ut K501) 1A<^ and non-1 AC students studying under three types of chemistry 
teacheis U > all I Al' classes; 1 2) combination of I AC and non-lAC classes: and<3) no 
lAC A ;sHs Tlie K-Milis were analysed tor both treatment (lAC vs, non IAC)and sex 
ditteiences (male vs. teinale)- Pearson Correlation coetficienis and analysis of variance and 
covanance techniques were used. 

Tlu* results mdicated thai there is no significant ditterence in laboratory skills 
related u> se\. The girls sci>ied as well as the boys. The lAC students' achievement in the 
laboratory skills test was siginlKanily higlier than the non-lAC students. Correlations 
between the Laboratory Skills Test and tests of conceptual and factual knowledge of 
chemistry such as the NSTA^ACS High School Chemistry Test or the lAC-developed concept 
and fact test were low enougli to indicate that the Laboratory Skills Test was in fact measur* 
ing a new dimension in a student*s chemical education. The students' enthusiastic reception 
of the Laboratory Skills Tests was a subjective indicator that they felt that their work in 
the laboratory^ was finally being recognized and rewarded. 

hi addition to extending the two research studies already reported and completing 
the JAC study of students* knowledge and the factors that are predictive of student response 
to independent study , some other studies that need to be initiated can be cited. It's 
possible that the Likert type attitude instruments measure only the more superficial opinion- 
type attitudes. How can the deeper attitude and science values of students be assessed? How 
do attitudes of teachers correlate with student attitudes? What role does self-concept play 
in either teacher or student independence in teaching and in learning? How can the essence, 
mystic or spirit i>f innovation in curriculum be effectively transferred from developers to 
teachers? These are only a few of the research areas that cry out for exploration. 
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A DESCRIPTION OF THE DEVELOPMENT OF ASSESSMENT PROCEDURES 
FOR THE SCHOOLS COUNCIL INTEGRATED SCIENCE PROJECT 

WUliam C Mali 



Introduvlion 

The Schools Council iiuegrated Science Project is being developed in the UK for 
13-10 yt^ar M pupUs and leads to a double ceriitkalion CCE 0 level. The first group of 
students to participate in trials commenced dunng September, 1970, Evaluation, assess- 
ment and meaMtiement have played prominent parts in the preparing and ammendingof 
the scheme: this papei is restricted t^) a description of the development of procedures for 
assessing objectives achievement by pupils. Models used by the project are described in the 
Handbo4ik^^^ the society, science and technology mtxle! is influenced by Lay ton's work^^^ 
and the nuxlel used lor puiducing the list of aims has been described by Hall^^^ A brief 
outhne of some ot the decision making involved m the project can also be read^^^ The most 
important model tor the present discussion is the learning model which was inspired by 
Ibui is by no means identical to) the ideas suggested by Gagn^"'*. Figure 1 illustrates the 
nu>deL 
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recall . 
recall 



recall . 
recall' 



recall, 
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recall J 
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Figure 1: The SCISP Learning Model 



The use of litis imwle! in teaching allows complete flexibility within a structured 
learning framewtuk. This is Hest illustrated by stating that in the examinations, none of 
the materia] in any of the pupils* books is tested. These books show just one way of achiev- 
ing the aims of the scheme, and so long as the 75 patterns with their associated concepts 
are learnt, then the student should be able to deal with the cognitive part of the assessment, 
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Figute 2 ^hows Hve onginal list ot atirs, and ihc ways these were revised attei the 
N?l assessment. 



1A 
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OI^IGINAL AIMS <1971) 



HEVtSEO AIMS nd73 on^vards) 



To T«rcali nd to und«rBt«nd that infor 
mat«on which would anabl* th«m to t«k« 
A leval i.ouT9m? in biology, physict, 
ch^mCUv or physical t-i»nca, would 
«rtabla tham to follow a lOb m scianca 
or tachtiolc^v. would anabia tham to 
r«ad popular aciantif ic raporting and 
to communicata intalltgibly with cthaft 
on sciantif^c mattara, and would enabla 
tham to purtua fcianca at a hobby 



Pupili should ba able to damonsirate thair 
degree oi competanca m. 

i9) recBlhno«rid (b) understanding thota 
concepts which would ariabie tham to 
pursue scianca icoursas in physics, chamis- 
try, biOlOgy or physical scianca) to a high«i> 

level or as a hobbyx 

ta) recalling and ih) understanding thOh^ 
patterns which ara ot impo''tanca to the 
scientist. 



2A To undarstand the importance of 
patterns to tha Scientist and to usa 
those patterns m solving probtamifc Iboth 
ct a laboratory and oi an every day 

type' 



Making critical appraisal of available 
information, from whatever source^ as an 
aid to the formuleilon or extraction of 
pattarns^ 

using patterns and making critical appraisal 
of available information in order {») to 
solve scientific problems and (b) to make 
reasoned judgments. 



3u To have tha ability to organixe and to 

formula'^e ideas in order to communicate 
to others, and as an aid to understanding, 
crttiwfli analysis, etc. 



5 organi2ing and formulating ideas in order 
to communicate tham to others. 



3A To understand tha relationship of 

science tu technical, social and economic 
development, and to be appreciative of 
the limitations of science. 



understanding the significance. Including 
the limitations, of science in relation to 
technical, social and economic development, 



18 To be honest in reporting scientific work. 



being accurate in the reporting of scientific 

work. 



2C To be able to usa resources <e.g. books, 
apparatus) <t thair disposal. 



designing end performing simple experi- 
ments, in the latwratory and aliawhara, to 
solve specific problems and to show per- 
severance in theee and other learning 
activities. 



1C To work independently end as part of a 

group. 



Attitudef 
Pupils illOUld: 
9 be willing to work (a) individually and <b) 
as part of e group 



4B To be willing to make soma decisions on 
the belence of probability. 



10 (e) be sceptical about suggested paturns 
yet (b) be wilting to search for and to test 
for patterns. 



26 To be concerned for the application of 
scientific knowledge for the good of 
the community. 



11 be concerned for the epplicetion of 

scientific knowledge within the community. 



3B To have an interest in science end technology 
and be willing to pursue this interest to higher 
levels. 



A aims Knowledge; 8 aims^ Attitudes; C aims: Skills 

Figure 2: Original and modified lists of aims 
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i^ioblciu soUnig** is seen iv> be tho uliimate cognitive achievement. Merrifield's 
application*^^ ol the stiucture o! intellect model*^^ to Gagn^^s eight types ol learning was 
used lo h> poilicsi/e seven types of SCISP problem. These are listed. <The letters in 
brackets icier to Ouiltord factors.) 

(a ) Interpretation of photographs or scientific drawings. 

(b) " Detection of ''errors^' in experiments. 

(CMT) 

(c ) Originality . or crtative ability (for example, in devizing an experiment 
li) test an hypothesis, or in suggesting uses for a machine). 

<DMT) 

(d ) Selecting from vanous pieces of equipment a particular one for a job. 
4 Althougli this can be problem solving, it is most hkely that this 
activity will be ^traiglit forward recall.) 

tNMT) 

<e ) Calculating the consequences of given information (for example, given 
present day trends, predicting tuture events). 
(CMl) 

(f ) Giving the best interpretation to a series of facts or observations, when 
a number of interpretations are possible. 

(LMI) 

(g ) Giving the one and only interpretation to a series of facts or 
observations. 

(NMD 

(Compared with Merntleld this has an additional factor, N:>1, but does not include DFT.) 

Toft 1971 Afsassment 

An attempt was made to answer eight questions as a result of the 1971 assessment: 



1. 


Which aims should be assessed for GCE? 




How should these aims be assessed? 


J. 


What weightings should be given to the various aims? 


4. 


Wliat form should the GCE assessment take? 


5. 


What will GCE double certification imply? 


6. 


Is problem solving related to high scores in either verbal or non-verbal 




reasoning? 


7. 


Have pupils undergone any change in their ability to achieve aims during 




Jheir tlrst year of SCISP? 




Can different problem types be identified? 
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A pv^pulanon oi about ^)00 U >eai old stiidentii diawn tunn a wide vaiieyi ot 
secondat) schools in London. Bumingliam and N. Ireland were takuig pan m SCiSP tnals 
and these were ihe pupiU who were assessed atiei ihen fnsi year ot SC ISP Tlie matrix 
slu>wn in Figure 3 summarises the procedures used and the aims which they were supposed 
assess. 



ASSKSSMENT 


AIM (see figure 2) 


PROCEDURE 


lA 


2A 


3A 


4A i 

1 — i 


IB . 

. ! 


IB 




4B 


58 

1 ; 




1( 




3C 


AH4 imeUigence test 


V'' 






. — 






) 












SCISP paper 1 




■ 






\ ' 


















SCISE paper 2 




























S( ISP paper 3 












>/ 








n/ 






>/ 


Teacher detailed assessment 






















v/ 






NFE R pupil opinion poll 












>/ 


n/ 




>/ 










Pupil self' assessment 


v/ 


























Pupil interviews 


n/ 












v/ 














Global teacher assessment 




v/ 




v/ : 




>/ 




v/ 


v/ 










7 factor test 





























Figure 3 : Summary of assessment procedures 



The AH4 test measures verbal and spatial ability . SCISP paper 1 contained 32 
multiple choice items which tested recall and understanding of concepts and patterns, and 
also pattern finding. The latter questions consisted of presenting students with data and 
asking them to extract the pattern from the information given, {Sometimes there was no 
pattern.) Paper 2 was the problem solving paper and consisted of all seven problem types 
in multiple choice and "essay ' form. Paper 3 contained questions like the following. 

Quesiion 

A new factory producing an important substance and requiring a large 
number of unskilled people was being planned. Unfortunately, a waste 
product of the factory which was emitted from a chimney had an 
unpleasant smelL Which one of the following courses of action would 
you suggest? (There is no one 'correct' answer.) 

A do not build the factory 
B build the factory well away from any town 
C build the factory close to the workers 
D do not build the factory until the smell can be eliminated- 
Explain your decision. 

Suggest cou ^s of action other than A D which might be possible. 




SoiiKN^ne who has siudiod ni> science says to you i know that energy 
can be conveyed by a How t>t water, or of air, or of electricity. What 1 
CdH i undeisiand is why electricity needs two wires, while water or air 
n»?eds only \^ne pipe\ 

Wnie several bentences explainit^g for him the similarities and differences 
between water, atr and electricity in conveying energy. 

Quesrum 

A scientist says \\c observed that when liquid helium was poured down 
the side of a beaker it ran along the bottom of the beaker, up the other 
side, and out on to the bench! 

1 What ^ould you expect to happen when liquid heUum is poured 
into a beaker? 

•^v 2 In whay way<s) does the explanation pattern for liquids not fit 

HI wuh the observation for hehum? 
3 Di>es this mean that the explanation pattern is no longer useful? 
hxplam your answer, 

TeacherN were given detailed notes for assessing pupils on a five point scale. (The 
notes had been written after detailed meetings with teachers, and only after general agree- 
ment had been reached,) 

The pupil opinion poll*^^ purports to test five factors: science interest, social 
implications, learning activities, science teachers, and school. 

The detailed notes given to pupils enabled them to assess themselves on a five 
point scale. For the interviews, a random selection of three separate groups, three pupils 
were taken and interviewed. They were encouraged to bring exercise books with them. 
These groups were chosen from each of eight English schools. For four of the schools 
the process was repeated with a different judge in order to moderate the judges. When 
When globally assessing, teachers were asked to give an overall percentage mark for the 
groups of aims A, ? and C for each student. 

The seven factor lest was devised on the basis of examples given by Guilford from 
tests which are supposed to assess each of the problem types which had been identified. 
In addition to these assessment procedures, teachers were also asked to weight the thirteen 
aims according to their estimate of importance: to suggest other ways of assessing aims; 
to state which aims they believed could not be assessed (and why); and to offer general 
criticisms of the measaring instruments used. 

The usual statistics were computed (means, s.d , frequency distribution, 
reliability, facihty and discrimination indices) and, in addition, a 40 x 40 correlation 
matrix to help determine the validity of instruments. The seven factor test and problem 
solving paper were factor analysed (principal components analysis). 

As a result of these analyses, and following feedback from teachers, the follow- 
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ing results were obtained; 



a. The cortelaiions between different levels of ihc learning Ineiarvhy were 
not high ^on average about O J), 

b. There was also a low correlation (0 28) between pii>bleni solving and the 
AH4 test, 

e. Pupil self assessment generally had insiginficani (0. I f level ) correlation 
with other measures for the same aims, 

d. Teacher assessment correlated well witli otlier measures, 

e. There were moderate (043) to fairly liigh (0,^3 ) cturelations between the 
various factors of the Pupil Opinion Poll 

f A and C aims (knowledge and skills) correlated highly (0 J4). 

g. The social implications factor of the Pupil Opinion Poll had low correlation 
with other measures of this aim. 

There was a higlily significant difference between the means of Papers 1 and 2 of 
the pretest and post test pi>pulations. 

The factor analysis was disappointing. The seven tactor test showed expected 
results, but when combined with the problem solving paper 2, clear factors did not emerge. 
Questions containing significant physics content were grouped together, and most of these 
were numerical. There was no distinction between multiple choice and essay questions. 
Ouesti«ms based on the same information provided in the stem had similar factor loadings. 

As a consequence of these results, and following feedback from teachers, it was 
decided to drop some of the aims, to refine others and to combine the knowledge and 
skill aims (see figure 2). Certain instruments were chosen for further investigation in 1972 
and others were dropped (e.g. pupils self assessment and the Pupil Opinion Poll). The 
weightings for the first GCE were also proposed and the 1972 assessment used these 
specifications. 

1972 Afieumant 

The same population was used for the 1972 studies, 

j^pre were seven aspects to the 1972 assessment of pupils* achievement: 

1 . To refine the chosen measuring instruments following the 1971 assessment. 

2. To decide how the GCE SCISP A' pass and SCISP *B' pass should be 
composed. (*A' and *B' are the two separate certifications offered by 
SCISP.) 

3. To compare the distribution of *A' and *B* passes. 

4. To produce agreed norms for the internal assessment of aims. 



5. To vompajo Sl lSP and iion-SCMSP pupils of the same age. 

6. To perform an item analysis of items which were not pretested. 

7. To compare art objective problem solving paper with a short answer problem 
solving paper containing identical questions. 

Five written papers <iwo multiple choice and three short answer or essay) were 
administered. In addition, an alternative form of the multiple choice problem solving paper 
(Paper IV) was produced which contained identical questions to thuse on the multiple 
choice paper but instead demanded short written answers. 



Specifications agreed for the GCF. 0 level examination were followed and these 
are slu.wn m figure 4, The aims correspond to the modified list given in figure 1. 





AIM ASSESSED TOTAL 




153 4 56/ a 9 lO n 
sb ababab 


Int«9r«t«d Sci«nc« A 

Papflt ntc«)) concept 

Understanding concept 
Understanding patie 
Pattern finding 


6 

4 

16 

24 


Paper Cognitive and 
1 non-coOnitive 


4 8 8 20 


Inngrated Science B 
Paper Understanding concept 
IV Understanding pattern 

Problem solving 


4 

6 31 
31 


Paper 

V Problern-tolvmg 


12 4 4 4 24 


Pap^r Cognitive and 
II non cognitive 


1 4 4 12 4 25 


Teacher ataettment 


8 44444 48 40 


Total weightings 


20 26 24 34 12 34 20 4 8 4 4 4 4 4 8 300 



Fi gure 4: Specificaiion for 1972 examination 



Meetings were held with teachers and questionnaires completed by them to 
develop a set of suggested norms for the internal assessment of aims. (Conventional 
moderation was impossible: because of the large number of school eventually to be in- 
volved visits by moderators was impracticable, and statistical moderation would have been 
meaningless because teachers were generally assessing different aims from those evaluated 
by written papers.) 

The usual statistics were computed for all papers. To our surprise, nearly perfect 
normal distributions were obtained for all papers except for the alternative paper IV. 
Double and triple marking of essay papers showed remarkable consistancy and point 
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bisciial ci>etiKients 1t>T the multiple choice ueiiis were geiieraHy in the 03 to 0,4 lange. 
Hie vanaiices were idetiiical for the two types ol' problem tj\>lvuig papei and the dilYercnces 
between means higlily siignitlcant. The correlation between the two papeib was 0,45. On 
anahsK. n was revealed that in the short answer version pupils were also achieving aims 
othei than '"pioblem solving" and were also being markod on some oi these ainiN. with ilie 
lesuh that the mean lor this paper was approximately one hall that u>i the multiple choice 
version. 

There was a correlation of 0.4 or less for the teachers' internal assessment of aims 
with aims assessed by written examination, thus indicating that teachers were assessing 
different characteristics. The teachers were also asked to assess student achievement on the 
wtuien papeis (before the papeis were attempted!) and the correlations between estimates 
and actual perfonnances were high (above 0.7). Tlie intercoi relation of tnarks for the 
various aims tested in figure 1 showed significant but not high values. 

A careluUy selected parallel population of non-SClSP pupils was compared with 
SITSP pupils h>r each level of the learning model. There were significant or highly 
sigmtkant differences between the means for the achievement of both populations, 

A comparison of the varnms way;^ of distributing the internal assessment compon- 
ent between SCISP A* and SCISP (to provide the double certification ofTered by 
hitegrated Science) showed that the internal assessment was best equally divided between 
the two passes. It was decided to make SCISP 'A' consist of Papers 111 and 1 with internal 
assessment, and SCISP consist of Papers H, IV and V with internal assessment, thus pro^ 
vidiiig a crude profile of student achievement in GCE 0 level. 

On the basis of the research (albeit necessarily "messy ^ because of its applied 
nature) the first GCE examination will be taken by pupU. this summer (1973). A report 
on this examination will be available from the examining board which is administering the 
examination for the Project on behalf of all GCE boards^^^*, 
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PERCEPTIONS OF SCIENCE AND SCIENTISTS 
BY 13'YEAR-0LD SECONDARY PUPILS 

DtmaU Hun hings 

Introduction 

Scjcncc iJCuUies \u univcTsiUCs in Australia, as in other countries, arc finding it 
nuue Juikiilt lo rocrun new Mudenls. How tar this may be attributed to possible shortage 
or employ meut i>ppiirtuiuues or to other tactors is a matter of conjecture, hi Britain, 
11 hjN been postulated thai an adverse image seientisis may be one taetor which has eon- 
inbuied to the lack o1 popularity ol science as a schtv^l subject (Damton. l%8). 

The lescitvh reported here Tor. v pari of the initial phase of a longitudinal in- 
vestigation K-iUi:..tnied out ai Oxford I'l.i ersitv Department of Educational Studies into 
liie tactois mllueiiou}; sccondan, school pu.>ilsin their choice of school subjects and 
possible career-. 

A questioiiii.iue on attitudes to science and scientists was developed in order to 
obtaui J pi. .tile ol liow iliesc are seen by siiird-year secondary school children. Com- 
parisons weie made between boys and girls, science and arts specialists, and orientation of 
father's occupation as measured oji a scale of arts-science bias. The findings indicated thai 
the traditional stereotype of the scientist is changing m several important ways which may 
be crucial to the choice of science as a subject, and that pupils understanding of the nafin 
i»f both the man and the job differs ijuite considerably along a number of dimensions be- 
tween the varuuiN groups. The main hypothesis is that the concepts of science ana 
scientists lonn an integral part of the framework within which this subject choice process 
occurs. 
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Previous Research 

The study attempts to differentiate between the scientist as a man and the nature 
of his work, and lias investigated a more diverse number of groupings than has been the 
case in earlier work (Hudson. 1%6). The aim is to identify individual differences between 
groups m their perception of the common myth of the scientist as an eccentric out of touch 
with society at large which do not. of course, emerge when the sample is taken as a whole. 
The 'halo effect' (Hudson. 1968). for example, can be estimated only by comparing the 
judgments of interested parties (i.e. those spcciaHsts viewing the mythical attributes of 
their chosen specialism with a certain de fen siveness) with those of the total sample of school 
children. 

Seimes (1%9). reporting a study of attitudes to science and scientists made by 
the Association of Science Education (ASE), commented that, althougli comparatively 
naive, the concern of a sample of 12-13 year old school children was real and that 'however 
inadequate their knowledge of scientists and their work, they showed strong feelings about 
what they believed scientists were doing in the world*. Tlie present research has tended to 
concentrate on the practical aspects of the job as well as the siKial implications of scien- 



tniw activny. The wlulJitMi pnned io hjvc vciv dehinlv ldcJ^ on ilKwe jnd \mi ihc kind of 
ivr^ion who bocomcis a scicnust. How lai U«n inugc is changmg. ralijcj ilun ihc vwicnt u> 
uhich it coucspondb ti* reality, may be iho cnicial tactor as lat as ihe subjccl chi^cc \>t ihc 
)ndi\)dual pupils is coiwcrncd. 

The Experimental Procedure 

2,000 third'veur secondary sch\u>! pupils, Iroin 17 schools in lingland and Wales 
were asked lo complete a questionnane on science and scjennsts\ The rcsuhs were 
CiHielated with other nitorniation already collected in the fust main neld uoik with Hiis 
sjniple. The tests lot this phase uicluded: 

AH4 group test o! general intelligence cxeniplitying a verbal-nuniCTKal and 
a diagrainmanc bus. 

JlSPiJ personahty questioniuire derived from CattelFs IbPF, 

APV *KCupaiional inieiosis guide. 

CPi quesuonnane puniding background mtoruiaiuni on socio-economic 
status ol the t'aniiK . level o! pareins' education, parents' ambnuMis tor 
cliiidren. jri!i-sCKnce o!ivnuiion ot paients' occupations, pupils' 
attitudes to school and sClu>ol subjects and their plans tor the luture 
as regards higher education and careers. 

The questionnaire was designed under lour mam headings: (i) science m school 
ihe abilities of scientists (ni) the character ot a scientist and (iv) the job of a scientist. 
The fust three were designed as a semantic dilYerential i>n a four-point scale and the 
lourth as eighteen true-false statements. 

The results were broken down by six main variables: (i) sex (ii) scientific interest 
as demiMistraied by the APU Occupational Interests Guide <iii) interest in science as a 
school si'bject and (iv)as a career as expressed in the attitude scale (v) subject group 
determined by expiessed preferences for school subjects and <vi) orientation of father's 
occupatiiin on a scale of art science bias. The inicntion was to identify those groups hold- 
ing the stereotyped view of scientists, which aspects of it are peculiar to the opinions of 
science specialists and which are common to all pupils. 

ResiuUs 

\2 ) Science in School 

The present data contlrms that, even at 13, boys are much more favourable in 
their attitude towards science at schi)4>l than are giris. 64 percent of the btjys compared 
with 34 percent of the girh felt that they were doing well in science. The girls particularly 
cinnplained that science involved learning too many facts'; also science teachers were 
less popular with them than other subject teachers. It is clear from Table L which gives 
responses on a four-point scale to enjoyment of science lessons, that boys seem to get 
eicator pleasure and saustaction from these lessons. It would appear too that tliere is 
O a much higher level of enjoyment in Physics and Chemistry than in Biology. 
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TABLE 1 '1 Mioy scttnct letioni* 



44) h> subject piefcaMiwe 

t 

Vtry irut 



Maihematics 2^ 

Physjc-.; Chemistry 60 

Biology -8 

Arts. Languages 9 

Social Studies 11 

N = 1*^03 445 



(b) by ^ex 

Very true 



Boys 33 

N = 1065 349 

Girls 11 

N = 838 % 



Quite true Not really Not at all 

39 33 6 

36 3 1 

51 19 2 

42 40 9 

41 37 1 1 

780 548 130 



% % % 

Quite true Not really Not at all 

45 18 4 

483 189 44 

35 43 10 

297 359 86 



The question arises whether science is more difficult for girls or asOrmerod (1971) 
has suggested, the emergence of social fact'X's at this stage of pupils' development, is more 
pronounced in the case of girls. An item in the questionnaire may thr.w some light on the 
first oi' these. It sought to discover how far boys and girls themselves felt that science was 
in some way more difficult for girls, and it was possible to correlate these responses with 
the results of the AH4 intelligence test over the whole range of abilities. (Sec figure 1 ) 

It is clear that the majority of boys and girls felt that both sexes had equal 
potentialiucs in science. However, at the lower end of the intelligence scale there was some 
tendency for the boys to agree with the given statement. The important point is that at 
this stage the pupils themselves feel that, on the whole, science is no more difficult for girls 
than for boys. 
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FIGURE 1 'ScisncB it mora difficult for girlt than boys' 
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(b ) The AbUities of a Scientist 

The findings of the present study indicate lhat there- is an overall consensus on 
the abihties of a scientist. A picture emerges of the scientist as someone who is very clever, 
not easily put off when things go wrong and very good at explaining things but who is not 
physLally fit and not particularly good at languages. However, there are a number of 
striking differences between the opinions of science-biased groups. For instance, the *I ale 
effect' was in evidence in the responses to 'uses his imagination' and 'full of new ideas. 
Though both items received a veiy favourable response <83 percent and 94 percent respect- 
nely ), iho science specialists were between 5 and 6 percent more likely to endow the 
scientist with these attributes. A rather more surprising result was that the opposite proved 
U) be true of the ability to speek and to be good at public speaking. In both of these cases, 
ilic arts-biased pupils tended to give responses more favourable than those of the science- 
biased. It was interesting too to note that the pupils did not rate particularly highly the 
scientists's aptitude for making things. This is perhaps surprising when the fictional Dr, 
Who-type characters of T,V, series ate always portrayed as very competent at constructing 
jnd repairing extremely complicated pieces of machinery. 
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TABLE 2 The Abiiititi of « Scientist 





Want to b« 
• «c««ntitt 


1^ 








1 




Ybi 

% 


^ No 


i 


% 


No J 


% 


Low 
% 


Total 

% 






92 


\ 92 


\ 


91 


j 

92 1 


91 


91 


91 






57 


1 69 




64 


65 1 


60 


97 


63 




Good <it 1di^Q*)«S4^ii 


23 


27 


\ 
\ 


19 


« i 


24 


24 

j 


25 






76 


j 66 


75 


73 » 75 


69 j 


71 






78 


! 68 

\ 




74 


72 ! 

i 


72 


73 ! 


73 




Good at p«t)i»t tn^iBa^nfiy 


35 




1 


29 


43 


37 


52 1 


4^ 




At>ie to •^rdt>r« 


43 


I 44 

! 


i 


42 


47 ^ 


61 


50 


44 




Full of riuw idoAi 


92 


1 « 


\ 


92 


88 ; 


92 


84 


94 






31 


! ^' 


i 


27 


33 ; 


28 


4C ■ 


34 




Usui tiis i»nag>'i«sito*^ 


86 


1 80 


i 


1 88 


«3 


87 


81 


83 




Not edK^v 


95 


I 91 




i ^ 


93 ; 


96 


90 


) 93 




Good at making Uung^ 


53 


! «^ 


;: 50 


^» ; 


47 


64 


BO 




Pu ts i/vo'i^ ♦»'«t 


72 


1 84 




. 79 


75 


83 


78 


78 




Good >at «xi»ij)nif*o 

1 


91 


J 

' 91 




i 

1 85 


90 

^ - ■ 


87 


91 


91 





Tabic : >ho>vs the dHYcrtMil relations existing beiAveen three pairs i)l arls-sciencc 
biased groups this sectiiMi. 

The hex ihai the scientist is seen by ahnosi jU as being goi)d at explaining thing- 
may perhaps be regarded as an encouraging commetu on science teachers. As Seimcs (1969) 
remarked o! the ASE sample 4)1 schi>ol children, ihey preferred a teacher who make time to 
explain expenmenis or practical work, or theory rather than one who seemed 'rushed along 
by th«" syllabus *n ihe book. 



(c ) The Character of a Scien tfst 

This dimension m particular is the factor most generally iliouglit to provide the 
basis of the scientist niyih, Selmes { 1^69) was leti with the impression ol nhe mad 
scientist ot horror tilmsand comic papers, and inference drawn from t!ie fact that 21 per- 
cent of the pupils" ct^mmciits suggested the image of a scientist leading a narrow devoted 
hfe. Sinularly, Ashttm and Meredith (1M(>9), ctmimer.ing on an investigation undertaken 
by the West Midlands Regional ( ommittec oi the '%SH. slate that the popular image of the 
sciennst was o\ j drab, bespectacled, overalled figure', bending over a bunsen burner in a 
back ri>onr or i^f a *dis)ievelled and wildly excited man dancing around, waving a lest-tube 
and talking to himself Me was also regarded, unlike the artist or sinrial scientist, to be 
quite unable to converse Murially. 



FIGURE 2 The Character of a Scientist by Interest in Science 
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ihu uuAm^s hA\c UMulcd to picscni muJi nioio vMWi^nagmg picture of the 
svicniiNt ,iNaxiinvtl> cttivioni poivMi uhois mmo m ihe ccniiv o1 things ihan locked away 
m a bavk i^oni He in not \ hc evventiu\ soliiau n^uie devoting Innii^eit to hij. Wiuk but 
nuivh moie mkkmv onontaU\i, \\oikuig m a \cam and deaUng with the world of pohties 
and biij buMnosN ilia! we iuive eojue to uvoumse thiough .he n^edia. 

Hie d^^eni unnded pti^iew^f i> .etiaud) iKvunnng ouidalcd, ()nl\ 18 percent 
.^t the ovetall sa^iple dcNCubed itie NCientiM as ver> ^uUe ahsent-nnnded and only 14 per- 
cer,! those KmM uneieMOd m saeuce as a MibKCt SnnilaiK , aiound 50 peicem ot the 
saMipJe desciibed hvn as vnb»>ititi company . being a !amil\ man and being ku^dl\ and cheer- 
tiil He was aK- Jes^nbcd a^ m\ inieie>U!:g pei^on and was not scon as eNpeci>dK dowdy 
and .unash^.MMble I iguic 2 nIu avs the paitei!? v^t lespon^os on li^ese questions divided by 
vCKMue miciosJ and jn.p.JMics the ingii degiee .onscnsUv !ie»e 

nil The Sifnij^r s Job 

H »A s.ibwM Ji.'Ke is related to caieci cht^ce is an open questnni. However, 
as tai ,is suetue is ^.MKC^i^ed. theie is a geneuii assumptum tlial boys and girls who choose 
s.'kMKe subicv f> Ajil pi^^b.ihj\ opt lot acaieei ni science. It this is so. the image ot the 

entist's ]iA> hkeU i'^ he an inip»>riant tacu>i m the choices being made, l-igurc 3 
ill ;xtiates \\w pupiK^ !esp.Mlsc^ oveiall cieliiocn inic-ia!se statements c^ncennng the 
-.cientist's w^Mk 



FIGURE 3 The Scientist's Job 
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llicse iindings conanily picsont a 'ooie tavoiuahk pictino ti! science caicois than 
thai found m the ASl: Muvcy. in uhicli N poiccni oi \hc coninu nis iclVcu^d a nciiauve 
or cinical attitude ihc work, T\\^ response^ sunuuansed in Figure 3 give the 13Aear' 
iildN* \ie\\s of the job a^^ being dUlicuh. secret . even dangerous, involving reading and coni- 
puianon. hut respoUMhle. well-paid and. on balance, doing more gi^od than iunm. 

Conclusion 

Hu.N paper provides data which should throw light on twi) imponani quesuons 
related to science teaclnng ni \\\c schools. The fust is whether 1 3 year-old pupils tend lo 
liave a negative view ot scientists and ilie work they do. and second to wiiat extent boys 
and girls ditler in ifiese aiinudes. 

We are entering here on an area ot opinion rather than tact and conclusions based 
lesponses given b\ the pupils must be t;eaied with some caution, tven so, the answers 
suggest that 1 3 yeai'old .secondary school pupils have a generally favourable impression of 
the NCientiM and his work and show that this positive view is shared equally by those boys 
and girls who enjoy science lessons and those who find them difficult or dulL 

Further analysis <M these profiles by the HSPQ personality variables will be carried 
out. It is also intended to extend the work in 1^)73 m luder to investigate the effect of 
two years* ageing on these images. As Hudson has noted, 'the consensus about certain 
figures lades over the tour years between thirteen and seventeen, wJule with others it grows 
sharper' Many past studies have not indicated who in fact endorses the stereotyped views, 

^kCientisis themselves believe in the image, and if the young science specialists' view of 
their subject is one peculiar to themselves, it is necessary to know how K^ng they hold this 
opinion. Do they reject the popular image, and if so. is this before or after adopting the 
specialism ' More specific information is needed over a larger age range, which we are hop- 
ing this longitudinal study will afford. 

The present paper has examined pupils who have some experience in science but 
who have not yet chosen or rejected it as a subject for specialised study. By this age. 
interest in science has crystallised, according to Butcher (1%9). Also the third year is 
the year of decision for or against science options for the majority of pupils in Britain and 
it is normally only up to the end of the third year that a common science course is follow- 
ed by all. The data obtained in the next phase of field work, v hen the pupils in the sample 
will be 15 years old, should provide information relating lo the various choices made by 
the pupils. How far a change in attitude towards science and scientists by young people to- 
day may be the result of a more favourable presentation of scientists by TV and other 
media, or to what extent this may be ascribed to the introduction of different teaching 
methods are interesting questions. 

These, and no doubt others, would seem to be issues to which the information 
obtained in this study may be relevant. 
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PART II 

TEACHING STRATEGIES, ATTITUDE AND 
i'!QU!RY MEASURES AND SURVEYS 
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ASEP IN THE CLASSROOM - some issues tor research 

I have been asked oxwVmc some of ihc pToblems associated with the use of ASEP 
materials, tlut miglu p\e use lo eduealional research progratnnies. These problems have 
been gathered t'join lepon.s meetings of trials teachers, dibcussums with trials teachers, 
m> observations of ASl P classes m action, and from my expeiienee in using ASEP materials 
wall (j!ade xS classes. 

Man\ vcience leaclKMs today are products of an era m education in whicli the 
teaciKMN lolc wa^» to nnpaii mfornvaiion, and the suideni\ lole to receive this informaxion. 
We left school with ihis view of ilie teaching-learmng process, and (despite out pre-service 
iraining). entered ilie prot'ession with much the same view. Twelve years of schooling in 
whuh vie \^cie donnnantly leachei directed, gave us a certamty that such a teaching 
>natcg> would be Micct'>sful toi us alsiK There was no haid evidence to support this view 
n^MeU our empmcal vibseivalion over a twelve yeai penod. 

We are ni>w jonfionied wiih an ASEP view v)f science education, and the resultant 
uini> reflecting tins view, which lell us that 

• a major source ot learning is liie activity of ihe child, 

• children learn by social interaction, 

• children should have considerable control over their own learning, 

• children shouM w^uk at their own rate. 

Many , if not most of us, are quite prepared to accept these principles per se. It is 
in the classroom practice that our previous certainties are shattered. We need hard evidence 
to be convinced of the educatiiMial worth of ASEP materials. Most of us/ir/ that ASEP 
science is excellent but our uncertainties run deep. 

The problems have been categorised in terms of 

(1) the context in which learning lakes place, 
Oi) ihe ASEP materials themselves, 
(m) the learner, 
(iv) the teacher. 

Context 

The ASEP view of science education, and its implicit view of the whole junior 
secondary education, as being directed tiwards the personal and social development of the 
child, poses some mteiesting questions. Tlie materials prepared by the Project seem to 
O ha\e been written for school situations in which rank ordering and grading of students does 
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noi ocvui llic unn miik uuc wiih a Nhotl Ciuo folKnvod b\ nuiiy iipiu>na! coic dovclop- 
incni actujtios. and iho abbCiKc aclneveiiUMU Icsls give suppou lo ilns idc.i 

• Wlui uinucncc do ciiviionincnUil piCNiUTOs have on AShP learning. 

\\) donund lor cinitinnnty \n a 5>e}uHiK a>> a^ani^t \\k cnannaucnicnl 
of individual cxprcssuni: 

tn) extTHisic rewards l\>r studcnis, a> agam^i mninjiie lewar 

im) rank oideini^ and ^radnig of students. 

• VVliai inlhKMUe dt>eN iho 'ehniaie' oi the be]uu>l ira\e on ASI;P ieaiinng' 
Are ASl P niaieiials equally e!teeti\e ni autluniiaiue and iUppuiine 
'jhniates*. 

• In there an i>pinnuni eoniext ui which ASI P learning will flourish" 
Materials 

ASI P inatenalN ha^e been de^ll;ned lo \^^^ ilie unereM ^n Niudenis. u> ^.ue! tvu 
Hkinidual linieKMKes abiiu> , lobe uMdable b\ ilie\asi majontv i>t students, lobe 
av:n\n\ -onented, and lo dt*\elop a wide lange oi abilities, skills, and attitudes. Th-'u^ seem 
1'^ be quite a nunibei oi iinderK nig assunipnons tliat might be subjected ti> lest. 

• What are ihe el Jeets on learning of the AS!:P strategy ot' 

ti ) lapping ilie inteiesi ot' the student- 
in) giving suidenis some choice in what they study, 
(ill I self-pacing. 

Uv) child-cenlied nisUuctii)iK rather than teacher-controlled 
instruction ' 

Cmiduciingan AShP class is liard work for science teachers. What wc want lo 
kn*^vi IS this IS our effort to be rewarded * 

• Wliat learning gains are achieved when ASEP materials are used? What 
ci^gnitive abilities aie developed, altitudes implanted or changed, 
manipuhiiive skills enhanced, and interests ev4)ked? 

• Wliat learning gams result fr4)m the use of open-ended, ot unstructured 
activities' 

One of the Project's major aims concerns the development of an understanding 
*5f the nature, scope, and limitations ot science. 

• To what extent do the materials attempt to achieve these aims * 
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• Wow MKvcssiul aic ihc nialoiuls in aLlneving ihci^e aims? 

A MimLn set lemuTkN mighi be made abi)ui ^'attitudes characteristic ot scientitic 
unestiviatiotiN^ 

Some icaJuMN icport that ASl P matoiials aic suitable tor middle and low ability 
sUidentMmh 

• In tins m !aci so * 

Ot iN mkIi a report an indictment o! the way the materials were used with 
hull abiliu classes, rather tlian of the materials theniselves* 

AS1:P niaioujK ctMisvsi o\ forty unus witit tew essential links between units, 

• Ulun IS ilic clYect ot' Ncquenciiig umis so that delinite links aie made use oH 

• Wluii ctJect on learning will a senes o1 non-linked units have? 

1 he icadahiluv ol nutenaLs has been a major concern o! the Project. An American 
ieadabilu> nh>vle! lus l^ecn iLscd, 

• Aie ihc m.iierials loadable to the extent that the American model 

mdicaies.^ 

Mom ASl P unitb have prepared and highly structured Record Books into which 
MudentN wntc then obNcrvaiions and answers to questions posed in other parts of the unit 
nuitenals. TliesC Record Books are clearl> very beneficial in many circumstances. 

• What IS the effect, if any. i>f such a confined and definite space on the 
qiiah»\ ot student responses? 

• DiVN the use oi such Record Bi^oks inhibit the tendency of students to 
pursue unstructured activuies? 

The Project has deveU^ped an inquiry model containing a spectrum of the types 
of inquiry possible. The types of inquiry depend on the amount of guidance given, rang- 
ing fri>ni a coniplet ly pri)grammed sequence to a situation in which the student is given no 
help at alK 

• To what evteni liave the seven inquriy types been used in the forty units? 

• How effective is each of the inquiry types in promoting tiie developmcm 
o\ ASliP science objeclivi.:^ ' 

Already quite a number of teachers have asked whether students are likely to 
becvMue bored with a three year ASEP course of study. 
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• h \hcic ail npununii nuinhoi ASl P uims taken in ^oqlUMKc. loi \hc 
various abiiuy ^ivmps* 

Our main v:i)nLCHi with \hc niaicnaiN ceniuw on ilicn oveiall otlCwinenoNN is 
achiCMng iWu istaU^d objOctnoN. Thn> \\ i> nnpoiaiuo Tnat an cMonsivo sunnnatnc o^.iUi* 
aiion oi ilio final ASl P piodiKi be vtrndueied 

The Teaeher 

An ASliP leaeluM Iun qune a dinerent une m ihe elassfooni. He is responsible tot. 

<U ihc oi^aniNatnMi M the taeiinieN toi learnni^; 
ib<H>ks. eqinpinent, loonU 

Ui) prepanng students for Icaining: 

lpre-iev|inNite baekgionnd, motivation) 

(nU ettcciing leannng; guidin;g. advising and eneouiagine 
Niudents aiihoy undertake then investiiiatioiis: 

{]\ ) evaluauii^ the elleeiivoneNN i^i learinn*:, 

Sueli a ri^le takes ihe AS! P leadiei out o! the Inne-ligin. out ol the eenire of ilie 
staiii:. Teachers someiinies lind it diitieult \o reiniquish the initiative, passing imi to students 
!nii!e ol ilie responsibiin\ loi ieaining, 

• Is such a lolo change a leal problem toi science leacliers.' To wliai 
kind ol science teacher ' How can this ditticuitv be minimised or 
removed* 

• Does such a role chan^je reduce job satislacti<>n ' 

• flow does an AShP teacher spend his time m class? 

Smcc the rt)le o! the ASliP teaclier is dif ferent, it may Le thai a .suecessful ASEP 
teacher diilers from a successful traditional teacher- 

• How can we identity a successful AStP teacher? 

• What attitudes and other personality components characterise a 
successful ASliP teacher? 

I'sing eiglit AStP umt\ for a one year science couise with a class presents a teacher 
witli an incredible burden of reading preparation. Each unit averages about 100 pages. A 
teacher using AStP materials with Grade H, 10 classes faces the prospect of reading 
2.400 pages of student text juit to become familiar wilh them. 

• How is it possible for teachers ii> become si) familiar wilh 2.400 
pages of ASEP matcriaL that they can pronu)te effective learning 
m the classmoni? 
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\Uu\ icJchciN who luxe used ASl P nutcruU cxpicsN unccftaiiUy as lo ihc qual- 
u\ and quaiHiu xhc Icaiiung Hut occuin hi iho coiuj^c ot a unit. 

• Him L-an such tcadiciN be coinuwcd ot the clYectJvcncs>* onearning 
wIkm) \Sl P inatcnal> arc iiscd * 

The Le:ini«?rs 

ASl P inaicnaK been dcsigticd to lake account of the wide variation in 
jbihiics and nUcrcMs at^d needs a>1 biudcniN, 1 have relViicd eUewhere to a number ot 
NtudiCN vvhuh might be conducted, centieuii! on how eUeciive the materiaU are in catering 
toi mdi^idual dilleTcnces between studetHs. 

Mun\ students wlien a^ked at ilie CiMnpietion ot a unit what they now know, that 
pieviouslv ihe> did ni>i. icspmid w some diUicuUy. Some even mainiam that tliey know 
nothing MhMC. 

• Mim can we prt>mote in students, the reahsation of what changes they 
haio undcrgi>ne, m tlie eouise of a unit? 

• >,tudenis reahse tlie intent o\ ilic activities they undeMake"^ 

• What el feet on leatmng and minivaiion does the regular marking/ 
correcting ot Reciwd Biu)ks have? 

Mn>i ASM* materials have been written at a reading level two Grades below its 
intended useis. 

• What effect di>es this low reading ^-^'''^^l have on the learning and 
motivation ot high ability students? 

Mi^st students seem to cope quite well m AStr classes. Only the very dull and the 
very dispirited (through years ot lailure), students seem to achieve nothing, 

• Is this in lact so? 

Tlie Piageiian stages ot intellectual development were undi>ubtedly useful to the 
Project writers in the development of the materials. 

• What use should teachers make of this concept? 

• How are ieachers going \o be able to determine t!ie stage of development 
of their students.' 

The unit M ALFS AND FHM ALKS has been designed for I : year old students. 
The core M the unit is so trank that it will invoke controversy wlierever the unit is used. 

• U the unit really suitable for Grade 7 or X students? 
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AShP niakMuU ejtci t»>i high abihiy siudcntNin uvo\va\> 
0 ) by providing a large numbo! <»rOpUon^, 

{w) by \hc iiKhision uiistnkuiied actnUKi»ai OiocnJ i>t Options 

• What \hc pancin pictcieiKc aiiUMjg higii abdny hUidciu^* l>i iiK*\ 
prclct u> do nu)ic Opiums, oi di> they icscaich mote doepK mxo an 

AShP maKMials lUMmalK vA)main ai least iMic diagnosUv tost ai xhc end ot the Cotc. 
Ni> avhicxcnioni icsis have been wnuen uidoed \mc ^ams ihe vinpressum thai rlie Pri^jeirt 
^un viMiMdei iho MunmaUNe cvaulation ol suidents loi iJie assignment ol giadcs lobe coiv 
Uaiv to their Mew of seienee education. 

h) a \\ pKal unit students ui a elass may l onipleie iToni one to six Options in the 
tuue alhvalcd 

• What teclnnqiieN might be employed m sumniativc testing to allow 
the variation in numbers i)1 Opiums eompletod by students? 

• NVIiat eltcet does testing ui order li> assign giades have on the students* 
approach \o learning, and on the learning ihat occurs.' 

Conclusion 

It seems lo me that science education in this nation will rcilect the influence of 
ASI P lor some considerable time. It may be that ilie Project's influence will be felt in many 
other subjects in the secondary school as well. 

Whatever the case there is an urgent need ior research mio the learning that occurs 
in ASEP classrt>oms. We need hard evidence lo support the widely held view of science 
teachers that ASEP materials and the ASEP view of science education represent a large 
step forward in secondary science education. 
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TEACHER VALUES AND THEIR ASSOCIATION WITH 
TEACHING STRATEGIES IN A.S.E.P. CLASSES 

i \ Power afiii K.P Tisher 

Ihc Us\ iiticon \cats have been dutJClcmcd by a grcai deal of inlcrcsl in ihc 
teaching leatnin^ pioeess ai^d many loseaTchcis fiave ditcclvd their attention to the dass* 
toim tu suid> what gi>es on. and what is happenmg to pupih. The ineteased research 
act3\itv has been leviewed bv seveial wrUvHsio g. FJanders and Simon. Nuthall, 
l%s ,jnd Roscnslnne and FuiNt. 1^71) and recently a special issue of the Intermtioml 
Rtvuw^f i ihuaih^n tVol .s. No 4. U)7ZJ was devoted to works deahng with the class^ 
roon) boluMou! ol teachcis. But e\eti though there has been a great deal ol study of 
teaching some wruers beheve ilui tlieie is httle •■pa>'o:r' toi practice. Heath and Nielson 
\ l^^^^i exauiple. paint a verx glovMny picuue of the value of. and benefits to be gained 
lioin tfu' le^e.iuhciN ou teacinng. Ulule 0 is ihe case ?!iai there are some difficulties and 
defuien^io in some siudKw it is iu>! the case, we beheve, that the research has been of no 
value I' or ex.iinple, researcfi tni classiAH^ni prtwedures has produced a greater knowledge 
of uhai is .K HialK happenmg m lessons. Also, research workers have developed and foster- 
ed A v.vabulaiv winch can he used to describe and catcgon/e classroom activities <and 
hopctullv gne icjchc?^ greater contiol aaci what the> do). Kuttheimtne. the research on 
uachiiig lias siimulaicd mniAations such as niicrivicachuig and mini-courses. 

Be thai as u mav . there aie several criticisms of the previo\is researcli which cannot 
be Ignored Fof example, there is the failure to rebte tlie criterion measures to the content 
cmered m lesstMij. jiid the purposes of each lessmi (Colien, 1^)72: Rosenshinc and Furst, 
l^ni ). hi many studies standardised tests have been used as the M.erion measures. Where^ 
as these msiiuments do measure some of the outcomes of instruction it is not usually the 
case that thcv are ilie most valid instruments lor studies, especially short term ones, which 
attempt to examine the association between classnuw activities related to specific content 
and pupi! growth. A miuc appropriate pnvedure in research is. according to some critics, 
to limit the nature i^f some studies of teaching to the examination of the effects of teaching 
strategies for specific curricular or specific curriculum units. The criterion tests would be 
hnnted to the material Ciwered in the curriculum units or in the actual lessons. Some recent 
siudiestlluglies. !^>73) have taken great eare to develop valid criterion tests and in two major 
pri»jects* in Brisbane pre and post-tests are based on the material covered in class. 

These last mentioned projects aie designed to study the effect of various teaching 
strategies in lessons where the pupils are following curriculum units prepared by the 
Australian Science Education Project. In one study a higlily structured unit, "Light 
Forms Images", was used in the experimental classes, and pre and posl-tests were designed 
to measure pupil's level 4>f mastery of the material in the core section of ilie unit. This 
stud> was also designed to take account oi the influence of teachers' beliefs about education. 

That teachers' beliefs abmit teaching and/or particular curricular innovations can 
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I hisi* proK».is hjve been Juna^a b^, ihe .Australun Adviviry Comm»iU«r fur Ktse.irih and IVvdop 
mcni in ^ Juc4lion 



\\u\\ n.iimo o! msiuKnoi? wnli iho ^uiikulum isgcneiallv accvpiod. I nti^iumatoK 
loo k\\ >iudie\ lake account \>\ the inodu\ mji ctlcci oi Uic toachc?\ vah.icb. <\Mtamiy. 
ihcie In a iKvd, a nunihLn t^l v^ntcji^ uvg. GrobmaiK 1%8) pomi oui ]o lake aaouni i>V 
!hc\e behcls ui ovaluauon o1 ciiUKula aud in ^tudlcs on ihc elteeis o! ^uaie^iios ol ivachin^. 
Hu> pt>Hn ol vjow i> a>5iOciaiod wuh .moUiOi, lianuK ihc expKbJjcd need to lake uUo 
aconuii ihe eifeeib \>1 perM>n en\noninent interaction^^ on pupib* achievement m cla>^ 
<MiuheU 1%^^ Powei, I'^'ll Miuhelli 1%"^) indicatei^. qune co^einh . thai the deiei^ 
nnnant> ot beiuvioui neod lo he sought n^oie oHen in liie charactetistk> oi ihe en\non- 
nienial conUAl and in iho niUMa^non ot the^^e chaiacunibUcs with mdnidual trails* and 
ahUuie> Ho >tiesse>. loo, \\u\ social ?o!ce> and envUiMunenial ^.ontexts may m certain nv 
s!ance> be picpoteni •nei ituhvuhiai tjjHv hi vnne ca>es Uie>e CvMile\i> nia\ hj\e ^\Kh an 
i:v.r.iensc impact \hA\ mdixKl.uii ^Hiu3\unn ^an he iu!l\ undof>to<)d when then eileci 
is conMde:ed KevenU\ . l oiien ^ \ ) iu> ai^ued along Muulai hne>. 

I ho Brishaiie Snidies 

\^ .^viKvitcd abiHc. the Uiish^ine studies attcjupt |4> take a*.>.Oiint, anu)nf otiiei 
*r.nie> li.v mtluenco o! K\u he*s bchcl> and tM' tlie actual content ^ lACicd m icsbons, 
\hc nuij.M n ihe pii^jecK ueie to examine t!ie CtlCcts oi toacinnji stiaUvics Hi vanoui> 

liip^ N;r^i!:-M^N uuluduie . i.iUi^hi b\ experjenced ieachcf> Thi> leport deals 

a:'! 'MIC snKr!! .ispe* 1 ilie ^^ilvjK•^ nanjeU ihc jss»Kiaiion heiween tCdchcis' \alu^*N 

a]:d KMvinni: stiateiiies \v.v*'inUs ^^1 oihci aspcclb oi the lebcaichcb appear elsewheic te g, 
iKb.c: ,t;ui Pnvei, r^"',^)jnd a detailed icpon a cx^mplcied project is available lioni the 
,1 »rS>'TN Howe\oi, n is appri-priate io describe stMUe ihe proc edmes 1i>Howed belore 
d:Ns. usMn>: in Ni>nicwhai ^iicMler detail the tindmgs which relate t*^ vaUiesaiid teaching 
Nnaieeies. 

hntiall> a leacher OpinnMis Scale <hased on the A.SJ:.P. Opinunis Scale) and a 
lea^lnnii Piawticcs Qu'^vnonnane weie admiiusieied lo a lepreseniative selection of science 
UMchets tS = OKK dipliMiia ni educaiii>n students (\ ^ 73)aiid A.S.t J*, stall <N = The 
da!a obtained uere analysed by using a principal CiHiiponents tactiM analysis V'anmax 
V. .^icn ueie obtained lor all persons and ten lacitus extracted m the analysis. The varimax 
Nv'MCs ueie Used in an Hieraichical Grouping Analysis <H GroupHVeldman. 19b7) to 
establish chisteis o\ individuals and a Muiii|»!e Discriminant Analysis was employed to 
deieimme llie manner m which the clusters established by H CJroup actually differed from 
each oihei 1 he chara*:lerislKs oi the clusters are described more fully elsewhere <Tisher 
and F*»wei , 1*^7.^ ) Twenty-one persons, i e. science teachers <N = 6) and diplomates (N 
15). representative ot ilie clusters were then selected at, the teachers to be used in the study. 
Tluse iwenty-one leaehers based live lessons iMi the material in A S r.P. unit Light Forms 
hiiages, and ihree the lessons weie video recorded by the research team. The experienced 
teachers remained wuli their usiia! giade class and used the aX.S.E.P. unit dumig June 
1**7^. The Dip >d>. each remained witli ten t*^ twelve randomly selected grade ^ pupils 
uln^ were m then assigned pracikc leawhing classes. They used the A.S.L.P. materials dur- 
me then seciwid practice peruid in September 1^)72. A pre-tcst (readiness test) was 
.idnmustered betore teaching 4>n the unit began and the post-icsts weic administered during 
Mie sixih lcss<>n. One ol the posi-tesis was the Classroom Activities QuestUMinaire (Steele, 
llnise and Kenns. I^^7| ) which is designed lo measure pupils' perceptions o\ the learning 
eiiMiomnenl. One was an Attitude \o Science Scale and aiK^tlier. the coterion achievement 
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The vuicoMapcs wetc unaly^od using a c]assu>om behaviour coding scheme deMgn- 
€d especially lor this study. Twenty cighi of the catt*£i>ries aiv hstcd jn Tabic The 
scheme pnwtdeji data on the number of nines certain peisons and materials acted as the 
NuUTv*c of mieraciions, the ftevjuerwy wnlj which certain interaction \>ccurred (e.g, pupil 
to pupil pupil to teacher), and the frequency types of hehavnnu <e g. fact stating, de 
senbing. etc.). Some categories are not hsied ni Table 2 as the interactions they mcasurcu 
were not sjgrnficantly assiKiated with any teacher values. 

The data from the Classroom Activuies Ouesnoiinairc was subjected to factor 
aiialysis and after vanniax rotanon eight tactors were extracted, Tliese Ci>rnponent account- 
ed lor 55' of the variance The names which were given to the components appear in 
Table 1. De'aded detmioons of the varums caieg\>nes aro given in the detailed report o] 
the study. However, the descriptions which follow will indicate the meanings attached \o 
a number of these categories. 

Coiretations were calculated between the teachers varrmax scores on the factors 
obtained fiom the analysis of the PxiiJiices Questionnaire and Opinions Scale and 

<a) classroiun priKess measures and 

tb) crueru^ji atntude and achievement measures. 

lire classroom pnvess measures included the mean scores (from the three videotaped 
lessons) for the mteraction measures shown in Table 2 and the class mean scores on the 
eiglit factors extracted in the component analysis of the Classroom Activities Questionnaire. 
The criterion measures were the i.lass means and standard deviations on the achievement 
pi^t'test and the attitude post-test. The results of the calculations are shown in Tables 1 
and 2, 

Dbcussion of Results 

The data in Table 1 indicate that there are some associations between teachers' 
values and pupils perceptions of the learning environment. For example, teachers who be- 
lieve that Silence courses should be "wide ranging'' including a great deal and variety of 
scientific information and information from the social sciences (i.e. teachers with a 
•^breadth orienianon") tend to have classes where the pupils perceive the learning environ- 
ment as one which devalues rote memorization, and expects pupils to go beyond the 
informanon given. In these classes, as might be expected, pupils do not perform as well on 
a specific, curriculum unit-related achievement test as do pupils whose teacher emphasize 
and restrict their discussions to specific items of subject matter. Also, those teachers who 
value divergence (unstructured) within lessons, jnd who encourage original ideas and use a 
variety of sources tor information tend to havo classes where the pupils perceive the learn- 
ing environment as one which values ideas mofc than grades, fosters invention and discovery 
(independent inquiry devalues memorizatioi! (ciamming) and where the teacher does not 
dominate discussions, 

A more complete description of si lence classes can be obtained by combining the 
data in Tables 1 and 2, It is apprtipriate ti note that only the statistically significant 
Q relations are reported m these tables and ihat the information applies to classes when 
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•\|vn v>i UMviKMNWuh diltonng cvliKaiuuul \,iiucNand the A.>k1'.P inaUMiols.uo a u pc ol 

ijni!0 artd \anol\ whwh wiUild o\in1 m BuNhanc ^ nKMnipt^liian Nchou! wcic it^ Adopx 
A S I P nuuMKilN iM ji^dUkm Nunibi Ncll-paccd nckmkc wOUim?. 

Soino oi \nn HUoipician\>nN o\ \]w dau arc .in tivHo\\>. 

1 I'eaclKMS whi^ \aUjc an e> pcMimental. pti^blcnvcOnucd appu^ach science tCvJcliing 
and vvhoboliovc in ^unipwoik tend \o ha\e classes in whuh 

(a) leadnig a pie\aleni ac!i\H\. pupils JK\]iieniK cor.MiU .nui oi inieraei witli 
eurnculuni nijlciiai> and des».npiuMi and diNC.J:iSiv^ii> \»l dUlKulUes .uc nol 
tieqneni aenvines. aiid 

{b\ pupiK peicene ihe leannng enviioinneni ^sv>ne which pcnniUagieai di.a! 
^>t paMu.apauon and unojvcmem and 'Alnch pjesenis cn]«>\.jlilc ulea^ loi 
Ntud\ . 

2 lea^heiN who pLke In lie \ahie an undei standing o\ xhc naiute iiHei-peiMnul 
ii.-Li!hHiships in claNsev and believe ihai schvni] ^oiiiNes shvUild Ci>nM5i ihe 
scp.ii.itv' Kitiici Uun ulteiZi.ited vieu^es lend i*^ iiaxi.' v.l.i>Nes in whkii j^upii> pci- 
lOjnc ihe leannng envut.iunent ast»ne vvhicii lequues iheni ix^ >c:i!v.]i Um iniplk- 
.iiuMis. iiendi and consequences in ihe niateiial presented 

^ leaciieis uht» place an eiv.phasis on iule> ii>ginde pupiib ci>nducu and who be!ie\e 
ihe> should diNCiphne .nid ciMiiri^l and make oJlective use puinshinen! tend to 
h,ive classes in which 

(a I lelaiivcK !eu questions, and particiilarK follow up question^;, are asked; 

discussion seei;is cenue around the giving t)f directions with less Iroqucnt 
dissemin.^tiiMi uiloimation. the teacher most Irequently initiates inter- 
jcnoiiN with mdivuiual pupils althougli pupil gnnips lalher than the teacher 
aie the irajiir SiUirce oi interactions: and 

fh ) pupils perceive the learning environment a*, one which requires them Ire- 
quently ti) explanu summarise and restate ideas in their own words. 

4 Teachers wht^ beUeve thai there is a iundaniental core oi kni>wledge which all 
pupiU should possess and that science ci)urses should Ci>nvey the structure ai 
v iences \o pupils tend to have classes in which 

id) criticism, deseriptum. bnel qucstitm-answer inieraetions and teacher use of 
and mteracti Mi with lesso i materials are trequent activifies winle reading, 
the giving t^l directions and observatuni by the teacher are not. and 

tb ) pupils var\ greatly m tlieir attitude to science and perceive the learning 
euNironment as one which places liule emphasis on (and consequently in- 
tieqiientlv lequncs them to engage in|analy>>js. logical reasoning, recjll, 
O , leLognitiofi. applicaiii>n and extrapolation 
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TABLE 1 

Pupiis perceptions and outcomes 
vs Teachers values 



1 *\u hors 



\ 


Perceptions of 




insiructional 




Clinule 


1 




n 


lujUuisusnc 






111 




IV 


Cranitir.nj! iR) 


V 


inierprcMa»u>n (R> 


vr 


Participation 


VIK 


Translation iR) 


vm 


Intiuniaiion 




Piowcssing 



B . Outcome Measures 

Acliievcment (Mean) 
Achievcmcni (S D ) 
Attitude iMean) 
Attitude (S.D.) 



-41 



(34) 



-41 



E2 



— o v. 



-37 



c ^ c 

C W V 



(35) 



-53 



43 



(-35) 
(-34) 
-4! 



(33) 



c > 



(3(>) 



= 5i 



43 



-51 



(-33) 



(30) 
46 



3') 



(31) 



45 
■43 



(-34) 



(-35) 



r > 0 37, significant at the 0.05 level 
r > 0.50, signilkant at tlie 0.01 level 



Nnte K \u parcmhcsis indicates liie reverse i *" the factor, tiius factor IV could be more 
"""" jccurateK . ii sonieuiiai ciumsiiy. de,sigiiated as "l)e-craiiiniing". 
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IcachoiN \\iu>bohc\o thai pupils ^atu hnlo Ium^) v\i!i\ini: out ihcji *nvii unesUii- 
an\>ns and that IcctmcN and dcMiiohstiattons shiniid lako picccdouc o\ct pupil>' 
Kibvnaion work lend to have ciaNSCN in whwh 

la) iJ^oio aic Uoqucnil\ pouudsi^l niacUMiN oi task inolc\ m\ aciiMHON.and 
more iVequoni dbcuNN:\^n ot pm poi^ON. and 

ih) pupils perceive ilie leannng envuotnneni as i>ne uiuch lequues explanaiixMis. 
\unnnancs and staietnenis oi ideas in liien own Wiuds, 

TeaehetN who vahic nurinsie motivation and d\^ not believe in ilie use of exinnsic 
rewards toi pupil accomplishments or excessive question answer interchanges 
tend to have classes in which pupils are otten t!ie initiators ot tnteractions but 
pupil pupil interactions are mtVequont. as aic discussions ot diHiculties. 

Teav*iers who value the subject matter oi the separate sciences tend to have classes 
in winch 

U) the teacher is frequently the "target'' ot interactions, tactual content is 
often discussed but reading is a rare activity, and 

ib) there is considerable variation among tire pupils in theii attitude to science. 

Teachers who believe that tliey should be tlie major disseminators of scientific 
mt'orniation and assessors of the accuracy of pupils' understandings tend to have 
classes m which 

(a) groups rather than the teacher are the most frequent initiators of inter- 
actions, periods of inactivity and task-urelevant activities frequently occur, 
observation is a prevalent behaviour whereas explanation is not, and 

<b) pupils perceive tlie learning environment as one which makes frequent 

judgments about them and rarely contains humour, e.g. laughing and joking. 

Teachers who beheve science courses should be such thai pupils are encouraged to 
use their own ideas, and who do not believe curriculum materials are the only 
sources of information, tend to have classes in which 

(J) praise and encouragement are treqiiently given but writing is a rare activity, 
and 

ib) pupils perceive the learning environment as one which places little emphasis 
on nieniiiri/aniMi oi (Ui grades, but encourages independent exph>ralion and 
discovery and values pupils' ideas. 
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TABLE 2 tPARTA) 
Classroom Interaction Measure vi Teachers Values 
(for 21 classes) 
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1 Pupjl iV) JN soUKV 






















2 (iiiujp {{>) as source 
















40 






3 Te;jchcf \ T ) as sxHircc 
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4, Tcachei 1 H as uigci 






















5. Matonals as target 


4U 




















5. P M interaction 
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7. P T into tact ion 






















8. P P interaction 
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9. T ^ M inieraciion 






















10. T ^ P interaction 






41 
















IK No (0) activity 










45 






53 




41 


12, Questioning (Q) 






43 
















13. Follow up Q 






-59 
















14. Information Giving 






-37 

















r > 0 37. significant at the 0.05 level, 
r > 0.50, significant at theO.Oi level. 
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TABLE 2 iPARTB) 
Classroom Interaction Measure vs Teachers Values 
<for 21 classes) 
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e1 ' 
£ < 
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" - y 

'a i c 

til 
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15. nnectuMi givuig 
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-37 i 














\b Wniing 


















-60 




17. Ob>crving 
















41 






IS. Reading 








-38 






-43 








iO. Q answers 








39 












-41 


Fact staling 














47 








21. Describing 


-42 






38 












42 


22. Interpreting 






















2-^. Explaining 
















-41 






^•4. rurposcS 






















25. Difficulties 


-47 










-41 










26- Noilnng/Task 










41 






45 
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Irrelevant 






















27. + vc AlYeci 


















37 




:s. - \c Atlect 
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43 
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H), I cachets W\k\v ilui? wioiKV comsON slunild be ^'>Mdc ranging ' combing 
nia]i\ NWKMiniK idcjN js vvdi as lolevani tinilings from ihe bdiaviuural sciences 
icnd li^ lu\o vIjnnOs m winch 

{A) ihoio IS neqiK-ni macnvity. task-indvani activities and description often 
occiu wheiea^ quesiion-aiiswer mteractums do not, and. 

ih) pupils peiccive the learning environment as one which places httle emphasis 
ow n'emon^aiu)n 4)r on grades, contams hitle talk by the teacher, but 
winch encourages them to draw miplications and search for consequences 
and trends. 

Concluding Comment 

The TONCarch described liere is part of a larger study on the effects of strategies 
o\ teaching m A.S.h.P. classes. In one j^ense the preceding discussion is incomplete for it 
must he lelated to tnher lindings in ilie large project. Nevertheless, the details discussed 
here prtnidc muJi mUuniaiion on the teaching-learning process, and, in particular, on the 
perccpnon pupils have <if iheir learning envirtmnients. It is left to readers to draw what 
implications ihev wi>.h trom the data we prefer ti^ bo cautious and non-committal 

We behcvc that many more studies, similar to this one, are required for tliey , and 
other researches on leaching, can provide the data we need on the ef fect teaching has on 
pupils' development, e g . pupils^ achievement. In order to discover what teaching strategies 
mnuence learning it is necessary to study classroom procedures and their effects. It is 
not suftkient to infer teaching strategies from learning theories. This project is a con- 
tribution ti> the large task of providing information on effective classroom procedures and of 
developing our undersiandmg of the teaching-learning process. 
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COMPUTERISED AUSUBEt - SUPPORT FOR AUSUBEL'S THEORY 
FROM COMPUTER SIMULATION STUDIES 

I Introduction 

\n a pojit tuK jnaKMN o\ mhuc sixiy biudics of achiovcmcnt prcdictiuj* in senior 
Nc^ondan oari\ undcigraduaic sciences*. Novak, Ring and Tamil conclude that 

\ - geneiai abiins . gcneial >cholasHc apiuudes ini^nesis, perst>nality 
tact«v!N, hi4^da!0 and posMhK other variables ahMie or combined together 
acvouni to] no tn<ne than 50 * of the vanatice regaiding academic 
aclnevomciu It seems highlv probably that pnor knt^wledge will acc^mnt 
fiM the ma]tM pi^itMn the remaining 50 Novak et al < 1^)71 ) p.SO^* 

U file rciaU^c M/e vM the ctUW o\ piioi kntnvledge t>!i subsequent cognitive learning in 
>vicnve IS anwvlKMC ncjt thai sUiigcsicd by Novak et al, then an understanditig of the ri>le 
ihai pno! knxAvlcd^c pia>s n\ Icunuig Nhould be a major mierest 4)f educational researches 
and should ha\e \er\ impoitam impiications lor the piactice K^\ science educalitMi. 

rtie desne I^m a thcoiciua! baNC to undeignd the relationslup between the learn- 
e!\s existing knowledjic aiid ins subsequent learning has led some science educators (e>g. 
N»njk n'>"^l Kuim { ]'^^2 )) \ o see Ausubel s subsumptiiui theory as providing such a 
KlsC. Ausubers theoi\ has ^onsideiable miuitive appeal bui it has not. as yet» been com- 
pleieK suppoiied by cmpiiical evidence, 

Jh: lescarch relating lo Ausubers theory has tended to ct)ncentrate on his advance 
org.uii/er niMi*>n. The results from lius research has prt^duced contradictions and contlicl- 
mg tesuhi, but im^s! o\ the appaient contradictions can be shown u^ be consistent with 
Ausubcl s the4>ry iWe:.l and Fensham in press). Very tew attempts iiave been made lo test 
empirically Ins more basic pi^stulate that meaningful learning occurs when the learning can 
be related in a non-arbiirarv and substantive' fashion lo the learner's existing knowledge 
(Ct^gnitive structure I 

Novak et al t 1) ui a post hoc analysis of a large number of empirical studies 
demonstrated that the results could be interpreted in terms of Ausubel's theory, but this 
is no\. as they p*nn! iuit, an adequate test of the theory. 

Studies by Ring and Novak { W71 1 Kahle < 1971) and Shove'son ( 1972) probably 
oxhausi the tield ol siudies that have pn^duced support for Ausubefs theory of .ubsumption 
under pn*M knowledtie. 

hi ihe .ibsence iurthei expeiimental evidence, one can turn i*^ alternative 
nietliods oi tlieoiv lesiing. In rece!it years, physical scientists have created simphfied models 
o\ complex s\ stems ui nrdcr dcv-?U^p or lest theories, The use of ctMiipuied Mmuiatuui 
models h.is pl.!\ed a ina|«n lolc in tins technique. It is dilficuh li^ know luw to assess the 
vahdnx '^t a ihcotx based on a pjoiium winch simulates a iminaii c^^iinitive pr4)cess. It is 
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Nu^jiiCNlcd h\ H,iii\\onh { i^)<vM tiui a pioguiin Uui ^u^uLlo^ iuiinan loaininj: boha\hM lo* 

Uknm\ In \h\\ paper such an a«.copiah]o ihcon obunncJ tiom v'njnpuici stnuiljiion nf 
,oio and meaningful Icatnmg shown lo bo >iniilaj to the iudepL*ndont]> pitH^t>scd theoiy 
Xusuhcl whuh is not based on eonipuiei sniiulanon (In laei, Ausiibel lejeets ihe posv 
\h\U\\ ot vonipuier nuxlcls pto^dinj supptu! ku lus iheoj\ AuMihei \ pj I 
believe thai ihis MnangiiJaiion' oi iheonos priUides suppoij \o the pioposiUtui ihji 
AuMibers theo!\ icprcseuts ilie puvess ol ineannijiiul Jcaunnj: in hinnan.s. The p]0|!ianis lo 
be dibeiiNsed m tins paper are The TeaehaWe Language <\Miiprehender (TLC) develojxM 
b\ Qiulhon ( U^b*^) which is designed to be capable i>f being laughi lo eonipiehend tinglisih 
text. This program represents a theor\ of meainngf'ul \erbal learning. 

t he Fiementarx Perceivcr and \lemonser(hPAM) developed by } eigenhaimi < ) which 
is deMgned to learn lists of paired ih^nsense symbols. This pro|;ram lepresenis a t!ieiM\ o! 
ix^e verbal learning, 

C'lMnpuier prograniN are precise. A iheoiy based on a progr;im will be a very de- 
tailed theory A psycliolo^^Kal theorv <Mk ii as thai ot" Ausubol) will luu be as detailed, hi 
vtMiipannc IK* and hPAM to Ausubel s theorv . the c<miparison w ill be made at tlie icrei 
\! Jaail speafiCiJ w Ausubei\ thc^}n\ The luriher detail m ihe iheiuv derived !roin ihc 
piograms, <which represent an acceptable thei^r> t'it the precise pn^esses involved m thai 
particular type o\ learning) will not be discussed in thij» papet. It is interest lo observe 
that Ct^jllms and Ouilhon (19t>9) have pn^duccd evidence, from experiments witfi iiuman 
subjects, ilial supports the detailed iheorv of memory siruciure derived from the TLC 
program. 

II, TLC and AusubelN theory of meaningful learning 

Compansion between TLC atid AusubeTs theory will be made under four 

headings 

(a) structure of the memor)' 

(b) subsuming new learning 

(c) an appropriate cognitive structure 

(d) obiiierative subsumption 

(a) Structure of the memory 

TLC has a N-dimensional hierarchical network memory, which contains units' 
atid 'pf^^P^^'^i*'*^ ^"1^ represents a concept that TLC understands. Ineorptnated in each 
unit is a link to (a) its superset unit (nvuc general ctMicept) and (b) at least one modifying 
propertv , A property is an attribute : value pair such as colour : red but can also be a pre- 
pi^sUion i^bjject pair such as up hill or a verb : i^bject pair such as paints : pictures. The 
annbuie and value are alsi^ linked to other units, Tlius a concept is always represented by 
H ) Its superset of winch it is a specific instance and (2) its properties staling how that 
Nupersei must be modified to Ci>nsinute that particular concept. 

Ausubefs view i^f Ci^gnilive structure is that it is hierarchical mi nature with con- 
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Wlivi! IH , .•iiii'u-lK iKis ,1 piovo KAi ii hcj^iiis In vaulinii; ihnni^h H^ 
;v,c!;i.-i\ uuuii,.! ..nM.«\i!n..u-s,, p.u.ilkl so.iuiU Jv'i M jppiopiKilc ifkmuiiship beuvcon 
...".vjMst; nuioisi.uKlMii ilu- it vMil uso tins Jiv>son ^oolh<no^ iisinenioiN (cognnive 
x',;suiuu-n.' n\..ko niicioiKos .ibxii! \W- nK\nanu .'1 ihc K>\i. li may Und, lot example, in 
lis !\o:n.M\ iK-uuMk, )nK>isC^u.Mi> <'Mlu- supetisct ^haiiisul the \voui> m Uio loxt thai il 
.luUMsi.tiuis n . Us.- ihis ikMwoik i.> uilo) tlio iiieamtig o! llio !c\! lh^^ iicMwoik enables 
u 1 . .u\u.- .1 '.epu-NvMU.iti.Mi >>! ihe mpiii K'\l uliuii 1n -imKii luhei and le>s anibij?u*>us 
lluui l!ie mpui km -.i-elf' atui wliu 1) k 'a \n^h\\ uiiKKoinieLMed MiiKMuie the vaii.nis 
v«'iKei-,N -n.-nn- iK-J i;i K\! hnkea m \\a\ s supplied In'iii aniemiM> ot ta^MNab.nU 
ihe v\ .'lUl ' 

\ '.;il>ei :^v ^ u>.>< leinis vlfs.nbe ihe lelalntn -'t new UMiiiiiig \o existing know- 
lediV -i i'U!iu'!.ii uMmiiiji liie !el-!n'>nslnp mu>i be ••ii.Mi-aibHiai> " .uul Mib^laiUue". 
Itie ii-.h-.,it>i(. ...f.Ns \ n.ii^lvs ;lu .ise p:«.vi.ni>!\ .Kquued knouledue I.' iiiieTnah/e and 
ik. vl.i' k' ..:i>! ilio vwbstaiun vi.ess •\issiiiiiljU'> ihe suhNi.nue ni ihe idea latliei 

',' ;m.-.in.- ids ised m .•xpu ss):.,- il.em" 1 lies.- aie aiv* die u'suils ul TI.C'n iiietluid 
• ' • ■ -i-;-) .i\ !!i ■ isv :K i\\«'ik inie.'Ne.n'Mis enables ilie inideisiandinj: 

\; 1 r..; .'.i <■ . si. r m ;;i;-:'.i. b\ ;lu- ueaiion .'t neu unils) ]lie nciwiMk 

.i'-.ui::. :nen; ie.ids • . i1k> \ o!iipietienMv>n' ot il.e lexl lalhei Uian die mieniah/.num ol ihc 

<v. 1 An jopro/jfure cognitive structure 

T 1 ( 111 u.s seauii !>n an appi.'pri.ue lepie.seiiialioii ot a pieee .d te\l. may tmd 
;n..u- liian ..tie sudi .aiididaie eogniine suueiiiie. An example ol dii^ i^ given by Qmlli«ni. 
l!:e te\i 1 "be .."nipielieiided is-J.-im sho,.!s the leaJiei" TI,C ila^ a uiiii lepresentmg 
J^.hn \u!h an asso.iaud piopctu phoMgiaphs siibjeel-s". h also lias a uiiii lor leaelierN 
vMdi an .,sv.. i.iied pi..pen\ Meaeh ebildoen l" In iIn ^eaieli 1 If will I'ind iniorseelions of 
eaJi -1 die supeisei eliains beginning ai John, subjeet.s. jeaeher and eliildren al the concept 
•peison' Ihiis tl.eie vmII be a sC! ol lelatioiuhip^ beiwoen {\.c. cognitive strucliircs idat- 
,ng> John and leaJiei. which TU' could use to niter the mcanmg ot the text. Clearly, the 
choice ot an iiiappr<ipnate one. util lead to a miMnterpretulion and the ciealum in njenuiry 
ot a misconception l.n thi^ paiticuiar meaning ol ^hoot-. TLC includes tests (called Morm 
tests )vv huh .an he used to check die appropnateness of a particular Candida. • cogmtive 
Niructure, .\s one would expect with the comprehension of linglish text, these fium tests 
ate based on si;iiple svniactic feasibility. 

\usubel also . onsideis the possibility of the use of inappropriate cognitive 
Mriu turcs Halt o! the loie of advance orgam/er.s is to alert the learner to die most appi>- 
pnate ...gmine sf,iicniie to be used to subsume tlic new learning. At the lasi A..S>.R.A, 
confetence. f eiisiiam 1 ) prop.ised that the use ol less relevant c«)gmtive siiucuires may 
lead to misconceptions being formed and Ausubel has agreed that this is predictable from 
his iheotv (peisiuial communication to f ensham). 
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IK \ iouu tosis.nc noi Ci]Uj\dkMH h> AusuhclN avhaiuc o^gani/CI^. hiu tho\ 

appu^pnaic vognuuc btTUcunc loi coinpiciicuMtMi Tuj \usubcl .idxaiuc o?^ain/c\s on* 
MUw* \hM ihc kMinc? uscn \\k mos\ appioptjuic cognunc nIujcUuc hn nioauniglnl loannne. 

{A] Ol)ifTer3twe subsumptwn 

MV\ pTi^^iess at this Maj:c has boon \o conipiciKMid a !anK hnincd tange of 
Mniple pluastSa?^d leniences, h i> js to pfocccd UiulKM, n ujH need a ua> oi kcvpnig its 
!nonuu\ uUlun Unnts. Quiliu)n lecoginscji tins problem and >uggcbt> a 5>o)ution 

''TLC also makes no ettori \o get nd ut^ nh^>i oi the new unu.s 
euMted durmg eon^piehension ol ie\t. Such new unus leptesem 
known voneept> pins ilnngN vnd about thenj m speeiiie instances, 
and an\ .idequaie Icaunng nieehaniMn nuist loiget sueh bpewUle 
instances, wlnle exiiaetnig an\ nnp4>iianl geneiah/auons lioni 
them ,iud adduig these the moie geueiai voneepis iett in the 
!nerntu\ Some nKMh\>d ot aelne\ing su».h geneiali/aiuin ai^d tvM« 
geitnie nnisi pi\>b,ihl\ be jMovMatmued betvue a significant aniouni 
i \ inennux cjn aclualh be bmlt np by leading text/' p,47/» 

OmUuni Is pu^pnMtig ihai 1 l i iieeds to u^e what Ausnbe! ha;* , oiled <>bliteiaiive sub- 
Nan)pnt>n ()n this i>sue 1L< i.nis as a t^^t il mode! oi AusnbeKs tiie^MX. but n is signitk'- 
,nu thai OuilhxMi should Cv)]isideT ilie process v>t v^bhteiative sub.^UinpiivMi as the dnecin>n 
]]} which Il(^ nuisi deveh^p in x>rdei lo expjnd its capabihiies, 

lir EPAM and AusubeKs iheorv- of rote learning 

Ausubel \iews rt^te learning as the opposite lo meaningtni learning. Throughout 
I he description ol Ins tlieorv . Aububel higlihghis the diiJerence between rote and meaning- 
tnl learning Thus he suggesis that toiely learned materia! is relaied in an ARBITRARY 
and VtRBATlM fashion lo cognitive structure in cmnparison to tlie NON- ARBITRARY 
and SrBSTA\TIVI\ tashu^n that he proposes lor meaningful learning. As a cinisequenee 
this. Ausuhel postulates lor n)te learning* unlike meaninglui learning* that anchorage is 
not achieved, that variables such as frequence and reinforcement are important fi>r learn- 
ing, and that interference on the basis of iiiier list and intraTisi similarity and stirnulus and 
respimse generah/aiton important variables t\)r retention. < Ausubel ( 1%8 ) p. 1 10). 

The correctness of this Mheor\^ of rote learning is important in Ausubel's argued 
development of his theory of nieaningiul learning. For instance, ou a number of occasions 
he explains obstacles to tlie development of his theory by the rote : meaningful comparison 
(e.g Ausubel i 1968) p. 1 15. * Alternative theories of retentitni and forgetting' I 

EPAM has two learning processes, one tt> construct the image? which f(»rni parts 
of II^ network ineniorv, ilie other lo build these images into the growing nei. 

The image building process copies a pan of the stimulus synibc^I so that it is 
distinguishable from the 4)iher images. Tins will usually be less than (and never nnue than) 
Mie VIRBATIM stimulus symbol. 



Ihe mugos .uc hudi unn j disviiinnKHion no! <mcini)T\ )hy the diNvrnmnation 
leauun^ piowVsN 1 ho UcM u no\ »Mguni/od \n any !t>gK'aS oi hieiaidikal schm^ bul sm\p\y on 
t!io basu oi whai in Millkicni lo? JjNCtmMnation ai ihat paUiculai pomi ui iiskarning, 
IhuN !lje jclaiionilup bvMvveen paUb ^^1 the net 0 w cogiuuvc biriKtUTC) isi compleicly 
ARBllRARN 

1 htso iwi^ loaimiig pivHVvsON aie eijinvalvMU lo AuMibor^ pTopositiDU thai tote 
icanung imolxcN an aihuan and vcibaum iOiatuMibhjp boiwcciJ new learning ami cognnivc 
NiUK'tute U IN lascmatui^ that the ettectb o1 iniei- and uuta-list Mmilaruy : oi stimulus 
and u^Npi»ti>o ^vnOKili/anon and ot lannhan/anon and nieaningtulness on learning and 
K'tcniixMi m 1 P.WI jnd 1 PAM-Hl ha\e been Nhown ti> agiee i^uantnatwely as well as 
.|uahiau\el\ ujth the data u^n^^ ideniwal expernnentb with humans tSimon and Feigenbaum 



IV 1 onehiding ( omnvenis 

ll;c ceiUial aiguniem pie^ented in lin^ paper is. 

i \ ) that there e\ist v*^mpute! Mmulation modeU of roie and meanmgful learning 
whuh iepre>enl acveptable iheorieN ni these c'ogmtive prucesseb; 

{!) thai tliese tiusuies are \er> Mnnlar to AtiNubei\ pit>pi>sed theiuies oi the same 
Ci^gnuive prt>cesseN, 

(.^ ) that ab a resuh . liie^e computer simulation models suppuri the proposition 
that Ausubel s thei^rv lepreNCnis the processes uivolvcd in rote and meaningful 
learning in immans. 

The concept of computer simulation models raises a number of interesting ideas 
ihai liave only been brielly mentuMied in this paper. 

One i!i the u^e i>f computer simulation models to propose detailed theories 
ci»gniiive processes Feigenbaum { 1^)64) has proposed a detailed Mnformatum Processing 
Theory o\ Menuny based on hPAM. He proposes a three level theory of memory: 

1 , An Immediate Menu>ry of very small size, in which hiformation 
IS stored for very brief intervals, which acts as a buffer storage 
to decouple the input (peripheral encoding) processes from the 
central processes and as a temporary storage for central pro- 
cessing. 

2, An Acqinsitii>n Memory, a working memory with the structure 
of tile hPAM discrimination net. in which di:;crimination learning 
lakes place and in which the internal representations of stimulus 
objects arc built. 

,V A Permanent Storage m which the internal representations are 
Q organized and stirred for long term retrieval/ 

lt?^C Ficgenbaum (l%4)p 14 



1 r\\1 In ,1 pii:Li>c loinnihiUon ot Uk' IniuicdKUv \^\\\\\s\uou \\w\uo\k\ \\ would be 

luuN xonipkMiUg \hc model liiis dei.nled model ol nuMiiou ctMild be used a basis loi 
Uesigiun^ leseauh Ntudus. 

AnoUuM niUMe>nn^ idea ^au be deu\ed Uom the \ise o! Momi tou' m I li Ihc 
w*ie o1 ihese !oiin lesUisuieiHivMl toiiuMoieoi advance oj^ani/ers. but ihe\ ,iie not 
ad\aiKL* oijiajii/eis I'eihaps we should be ilnnkjng o} a ^ciKMal coneept ot oi iiam/anunal 
uhi" .^1 wi^kl^ adxaiwe oiuanji^ets aJe ,i Npo^ilie example lajhei ihai^ tlie ikuiow voiieept o1 
.id\auve oj^am/eKs pioj^oNcd b\ Ausubel 

RfFERENCES 

\usnbel OP il^insi ' IduvjUiMUii IN> Jioioi>\ A « 'o^niU\e View' Holi. Kmelun 

i 'iin V \ \1 A ^).nllbM^ \1 K i]*HrJ} Kou un ,il I nne 1 j oiu Senuin : u Mcjium \ 

1 c\c^^''^\vy.\\ I ^ < 1*^*^ ^ ) "1 iie SiMHilaiiou oi Verba! l eainnij! HehaMoT' in 'Compuiets 
l!n-.ii:hr Id i ;'!5:enbju:u 1 \ \ 1 eldiuan. J. MLtiMw-lbll. 

} ;ievMil\i.i:,i i A (1*^>^4) ileineius oi .Hi InlonuatUHi PioLCisnii: riieoiv oi \1emor\*\ 
jMeNOiJU'd lo Amciuan Tsv^^holojiKal A^^0Llat30IK Annual MecUng, i us 
\uiieles, ( ahlonna. Sep'einbei I^)b4. 

} o^.Niiain. V J ^ I'^^l ) 'Vu^H Kuouied^e A S\3Uiee o| Negatne ^aLlol^'' Ke.seaieh 
I'-i^l I d K IV h^her. I iinersiiv oi Oueeiiiland. 

HalU^nih. H J 4 hU>')) *( ompuier Sirnulaiiini C\»gnilive Pni. losses" l'JUiUtii)tujl 

Kahle J H iP'^l ) The elleet of an advanee organuer and iho predienve abiHiy o\ 
injLto ieatnmg laisks ulien unh/ed with earefuily sequenced audio tutorial 
units" Fil l). TJjeMb. Purdue I 'niversiiy, 1*^71. 

KuhnJ)J tl^^72) "SLienLe leaehing. Concept FonnaiUMi and Learning Theory". 
Si U nu'LiiuiaaoH, 56(2 h 1H*>'1*^6, 

\o\ak.J D tl''"^lr "Concept U*arning in Science*', Viayry into PraciUe, 10. 12^M33. 

\o\.,k J I).. Kmg, D & Tannr. P. ( PHI ). •liUerprelalion of Research Findnig^ in 
unns m| Ausubel's Thei>r\ and hnpheations for Science Huucalii>n'\ Scicna^ 

Uiiiihon, M k { 'The Teachable language Comprehender", Comm. ACAt, IJ(^K 



BEST COW RVWlMlt 



SlundsoiK R \ 1^^" ' i Sninc Aspcvis m ihc <\niespondeiKe Bciwoen Contcni Suuciuie 

StmotuH A \ ! Oigcnbaunu I A {VH^4) -An Infonnatuin Proco^Mng Theory otSon^^ 
MteciN o! SnntUiiu , hamihaii/aUon and Mcainngluluc:^ in Vcjhal Leanuag \ 

West. I- !il & Fcn^lum^, P.J. To be pubUsUeU in ^Siudies m Science Hducation, Leeds 
rntveisity. 



THE MEASUREMENT OF A SCIENTIFIC ATTITUDE CURIOSITY 

K B, ilcggdmiA.A fiakim 

1 UuvaU^iN hjvc mciudtx ihc dcvcK^pnivMU oi SLKMiUlk auiiudcs a:, an aim o\ 
^.icnvc tcavhini! loi mam >cai> The wnnngs ol Cuiun imZl NoU { b)35). Hciss U^5«) 
and 1 iMkMio { V^^^)\\\\\sUMc ilus iacl Duung thai nine, howwof, ;'SbesMnent oi 
acci^mphshnKni ol ihi> auu ha> been geneiaily onnlted in ihc ovaluaUun oi student ptogicss. 
DuiKuln m r,K\iNMienienJ haN been at least one laetor lespoiiMbJe Un this onmsion. In- 
vKMNUii^fiesMne is now bcnigexciied on tliC clasMoom teachej lo take the ain) Nenotish. 
BoUcn i ]^ ^l")haN mdivatcd thai lite as>e>>nient o! attiiude> has been pan o! the 
ihn^kijii: c\.i!ttnuno!l^ wludx \\)\\ enteige as a KVNult \M the Nuttield Secoiidary Seience 
Pl^Ic^i .nid \\w SvhooKi oun^il t!neinatcd Seieitce Pioicei m 1 nglaiid. In New Soutli 
WmIw umlmic! Jc^p^»!1^^bll^^ iluin hnlRMio in \o be plaecd upon tlte leaehci \u the mnua o\ 
asNCNMnont .md iho Nee<Midau Seinu^s Board { l^J7:)has pioposed thai M attitude ditnen- 
^h^)) is lo niakc ip M) o! ihc niaik \oi tiie Mibjeet Sckmicc ni iheawaid i^l a Seinuil 
( ^ .Mru-iie Ih. ic In an lUizem need ."ieatei detuntion oi objevttxe>. and bn tests to 
.iNMNi Ica^MCJ in his UnK 

In u unncs Mich as llmse <ned aho\e eunoMt\ has ^enetalh been ineluded as one 
?ho deMiabic vienniu .iniiiideN lite present papei lopous pioj»iess tn an investigation 
uln Ji ^ev^^ to make a v\>ninhution lo mt^LMiiii: tlu" need hM nteaMinng tnstinments in 
rclauon lo the NCicnlific atiuudc eiunvMly. 

Previous attempts to measure curiosity 

Apaii \nm\ same cailici work by Bcrlync ( l^)hO)nn)sl of the iep<uted invcstig- 
a'lons oi cxpUualoiy beluMour involving human subjects date Ironi the beginning oi the 
lOoUsPtelstjckand'Ain: innMU^b4)and Peterson and Lowery (h^6S>uscd observations 
oi Jnldren s exphnatton ot objects u\ a specull> arranged envirtunnent e.g. a waiting 
iot>ni, io measure curiosity. 

Maw and Maw { 19M ) used a C4)niple\ piocedure involving peei. teacher and sell 
ratings io establish cnierum groups oi'lngli and low curiosity for subsequent invesiig- 
atunis ot" tfje relationships oi curiosity to ccrtam other variables. 

Methods winch would be more easily eniployeu by the classrotMn teacher were 
adi^pted by Penny and McCann ( 1%4K Jenkins (1%^) and Campbell { 1^71 ). llaeh of 
these lised scales uivolvu^g opinion siaiemer.is thougli none of the instnmients was of tlic 
gcn«*rally aecepl^d types of attitude seales. 

As a fust stage in present investigation it was deeidcd to develop an idea put 
forward at an earlier dale by Hukms ( 1963). This used Berlyne's coneept of epistemie 
curiosity, Berlyne (I960, p.:74) described this as '^ihc brand of arousal that motivates 
the quest for knowledge and is relieved when knowledge is procured''. Tlus appears to be 
related to the "thirst for new knowledge" of the cluster 5 obtained by Cohen (1971, 
p. 141 ) in his analysis of the components of the scientific attitude. 
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An appi\>ach the incasutenKMU o\ this kind \it curiosjiy miglu be u» pioduce 
a Nw.a!e lelann^ lo the persiMf^ altitude to \\\c specking o\ knowledge. 

Procedure 

A Liken type scale was pioduced accoru. ig U) the method mutinied b> l:dwards 
< 1^57). The Likeit scale wa5> selected because u is regaiJed by some authors, e.g. Tnandis 
{ 1^>?1 . p.45). asai least equal to and possibh superun to, the Thurstone ot Gutiinan 
t\pe scales ixu rehabihty and validity. 

In Older to v^btani siaienvenis lor ilie scale a set of questions was drawn np re^ 
iatnig to liie student^ desue to gain knowledge, the strength ol this desiie as evidenced by 
'Us leaciiin^ to tipposuiini lo his questions, his reaction to new situations involving things, 
places 4)r people, and his opinions about gaming nnormation from sources such as people, 
b\H^ks and the media. The questimis were desigjied in such a way as to elicit extended 
aiiswcis t!\>in the siaicmetns. (>9 t>t>m IV students in iwti high schools rosp^nided to these 
questiofiN and from thou ajiswers \^pinion sia' .^ments were selected. 

The bO-ucni protoscale was adinnnstered \a ISO students who had just completed 
thud torm m twi) Ingh schiu^ls. The reNpi>nses were subjected to the rehabihty maximiz- 
ation procedure ol' Ray U*^72 ) to prt^duce a smaller scale of high internal cimsistency. The 
25-iieni ' New Knowledge Scale'', included as an appendix, was thus produced. 

in an attempt to gain evidence about validity it was decided to form criterion 
groups of students high and low on curiosity, as rated by their teachers, tach teacher was 
asked lo select the five or six most curious and the five or six least curious pupils in his 
class w ith the aid of a set of criteria. This has been carried out in a preliminary way only, 
at tins stage, with five teachers producing "high"' and "low'' groups having a total of 28 in 
each. The attitude scale was also administered to these classes and the scores for the two 
groups compared. 

It would be helpful to know the relationship, if any, between attitude to know- 
ledge-seeking and other variables such as science achievement and intelligence. Maw and 
Maw {\^)10) have reported a correlation of J6 between curiosity and intelligence, A 
science achievement score was obtained from the schools and LQ. data is being sought 
also. 

Results 

The value for the reliability coefficient obtained by the procedure i)f Ray was 

The null hypothesis, there is no difference in scores on the attitude scale between 
those who are rated high in curiosity by their teachers and thoS2 who are rated low, was 
tested by the Kolmogorov-Smirnov two-sample test (Siegel 1956). With N 2^ a value of 

= 10 is required for rejection at the .05 level. The obtained value was K^^ = 7, Thus, 
although the difference in the cumulative frequencies was in the direction which might be 
O „ expected, it was not sufficiently great to reject the null !iypothesis. 
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Ai.orrclauou vocUjucm tx)? sCiCnco achievement and attitude to knowledge- 
seeking was calculaled by the Spoannan rank-ditleience method. The value of rho was 
t\mnd to be 0.20 indicating a verv Mnall relationship. 

Discussion 

The wompansxMi between attitude \o knowledge-M?eking as measured by the 
attitude Ncale and as luted b> teachers has niU led to a dctimte conclusion because the 
numbers ot teacliers involved was too small However the result suggests that it would be 
wonhwlnlc pursuing this hne ot investigation. This assumes that teachers are able to 
disunguish between the most and least curious students in then classes on the basis of the 
cnteiia given. 

An internal-consisieiKV measure of reliability is involved in the Coefficient re- 
ported above, \ \ would he advantageous to know the test-retest reliability, coefficient and 
this IS cuitcnilv being nivesiigaied, 

I he nncNtigatum repiUied here iClates to a self-report technique for measuring a 
scientitK atinude. cunosiiv , A question to be considered is to wJiat extent such instru- 
nientN. usetuj \n re^eaich situations, arc useful to the classromn teacher in arriving at a 
NCtnc ti^ be included m tlic assessment of his students. They would probably be much less 
valid if the subjects tell that the\ weio under some pressure because the results were to 
count towards an aw aid e.g. the Sciu>ol CeititiCate in New South Wales. Another question 
which many educators would Hke Xo consider further is whellicr, on ethical grounds, the 
as,se,s,snient t>f attitudes sluuild be taken into account in the granting ot an award. 
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tMAMt ASS: ...^ 

THE NEW KNOWLEDGE ATTITUDE SCALE 

Heio ate some Niatomcnis t>t>ni suidetus about the way ihey Uunk and act. As 
ytu) read tbeni you will t'lnd youisc!! agicein^ with some, disagreeing with some and per- 
3:aps \ou wiU be undecided about othcis. Youi }ob is \o say just how much you agree or 
disagiee witii each of the statemont>. Remember that no matter which choice you make 
there wiU he many people who iJnnk the same way as you do. 

HERE'S WHAT TO DO: 

hacli statemem In ti^llowed by the numbers 1, 2, 3, 4, 5, 

H yi)u sTriitiglv j^rec. pui a ciicle aiv)Und 1 . 

l! you jj^iv. put a ciicle around 2, 

If > ou aie ufhh'cUi'iL pni a ciicle atoimd .V 

It youJisagnw put a cncle around 4. 

}f you sfrangly Jisu^et\ pui a circle around 5, 



FOR EXAMPLE: 

Supposing there were a statement like the following and you strongly agreed with it. This 
IS how you would indicate your choice: 





Strongly 
agree 


Agree 


Undecided 


Strongly 

Disagree 

" Disagree 


88- Too niucli knowledge can 
drive a person crazy. 


a 




3 


4 5 



Give your judgement on EVbRY statement. 



Work carefully through each item and doM i spend too much tune on any one of them. 
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si \1 1 Ml N !S 


J- 




5- 

s 




1 




1 : 




4 


5 




\ piokM u> icani ]no!0 aboin l;ninh»n linngN lailici ihuii 






4 


5 






j '^ 




4 


5 


4 


1 n\ U^ok as n ] undctsund iliings. o\on n 1 doni. 


1 


> 
> 


4 


s 




U dt^L'sn't nuiiioi lu'U a liiuig \vnik>. wiuu il diics is 
:!u>!w' unptM lajh 


1 "> 


> 


4 


5 




V\u la/\ i.^ look up a!i,sv\LMs lo nn qiiouos u\ books. 


1 




4 


S 




\ isUHiji new pi.ic\'s Is a iv»\ loi nK\ 


) "> 




4 


5 




ji 1 vOuSd goi uiiai 1 uani in lilo wnlunit km^ving a 
ilnng. 1 wonld 


1 ^ 




4 


5 




I i!vM otUluisKisiK whcn 1 nu\M pooplc uuli ncu ideas. 


] T 




4 


s 


U» 


hucnuoiis aic nuneiiing. 




> 


4 


5 


! ! . 


It people lotuso lo toll NiUi thing>,\ou want lo Inid oui 
.ill the nioie. 




> 


4 




i:. 


1 like to kihiw what niakcs lliHig.s liek. 


1 




4 


5 




knowing iv)o niueh would niako lite vci\ honng. 


1 T 




4 




14, 


rd hkc i4> get J g4>od lin)k ai tilings oiii there in spaee. 


1 




4 


5 


15. 


Oilier petiple's inventions give ine idea>. 


1 T 




4 


5 


Kv 


1 won't rest until 1 llnd out about something which 
uitngues ine. 


1 


3 


4 


5 




It's a waste <M*time \o look things \ip in a library. 


1 




4 


5 


IN. 


A pers\Mi with an enquiring mind is a threat to those 
around him> 


1 




4 


5 


i'». 


1 i>nly read the eomics m the newspaper. 


1 


3 


4 


5 


:o. 


it IS almost ennnnal to be the least bit intelligent. 


1 1 


3 


4 


5 


:i. 


Strange places are fascinating. 


1 1 


3 


4 


5 




1 enji>y looking at the newspaper headhnes \o find stme- 
iliing that might interest mc. 


1 2 


3 


4 


5 




I like to learn tlutigs f rom people who put them forward 
m a new way. 




3 


4 


5 


:4 


1 hke to stay in familiar surroundings. 


1 2 


3 


4 


5 




1 hke keeping my mmd free of problems. 


1 T 


3 


4 


5 
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A NOTE ON A POSSIBLE ALTERNATIVE TO LI KERT SCALES 

RT Mnrv ami UX Muckay 

Criticisms of Likert scales 

l.ikcu ncuIcn are widely used \n icsls ot atntudei^. The test of cunosiiv developed 
by Fleg^ and Uukins (in iliis isbue) a upical iciii ot ihiJs lype. Throe general cnucmm 
o! Liken scales are made below , ihose cruidsms ate not meatu u> apply specifically to 
Huknis kvnK winch i> constructed m acCi>id with llie accepted prnuiplcs i>f Liken scales, 
h\\\ ate an attack on the accepted principles themselves, A suggestion toi an alternative 
piocednie is ilinstiated h\ reteience to the measuie i^t cunoMiy. 

Cnticism 1 . 1 ikert scales lack validity bec;^use it is otten simple tin tire respond- 
ent> to perceive the intent ot the itemN, and tlien those whi> have a set to score positively 
ttM neganveiy ) on liic dnnension being measured vvili slant their responses accordingly. 
The test then measuiCN a complex Ci^mbination of the lespondent's standing on the 
diinciuion bcme measuied, of his ,ibilu\ to perceive the intent i^f a >et of items, and of his 
set to lespi^nd in a particular way, 

( rincism ^. Sciues on 5-point Likert scales are attected by ifie di)gmatism of the 
rcspAUideni \loic Jo^matic people uiil lend U» cliooso CMienie values, and so will appear 
nitue (oi Iv-Ns) cuMous ilum someone less dogmatic though of really equal curiosity. The 
unK e\cep!io]> i> tor people vvliose total score on the test is equal to the mid-point of the 
range t)t possible scores ilieir dogniaiic tendency in one direction is exaciK cancelled by 
their tendenc> m the other direction. 

Criticims 3 Resnondents may have a geiieial positive or negative set in answerin>» 
Likcn-scale items. Some ^ ople may tend to ciioi)se the "favourable"' respimses of "agrc^" 
ox "strongly agree \ or whatever the phrasing of the responses is, while others niay tend to 
chi^ose the "unfavourable" responses. Their scores on the scale therefore arc a composite 
of their set as well as their standing imi curiosity, or whatever diiiieiision the scale is attempt 
ing to measure. 

To meet these criiicisms the alternative procedure must disguise the intent of the 
test, at least to a greater degree than the Likert scale; and it must be free of the influence 
of irrelevant attributes such as dogmatism and pt^siiive-negative response set. The pro- 
cedure described below appears to have these properties. 

Alternative prwedure 

Collect a number of statements that describe the writer, in the first person, e.g. 
Flegg and Hukins' item ^ ] get very enthusiastic when I meet people with new ideas", 
and which clearly have some direct relevance to curiosity. Other statements of this type 
are Hukms' items 2,4, 6, 8, 12, 14. 16, 19, 22, 23, 24, and 25 though some of these, 
e,g. 2 and 24, are negatively or anti-curiosity phrased, in a logical attempt by Flegg and 
Hukins to meet criticism 3. 
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1 ollovi a Liieci nunihLM i^l >taicnKMi]s oi Minilaj Uuin. whicli do not have iclovance 
tocinioMU but whwh icialc !o adiVLMscsci oi atlnhuics. hx^unples arc: 

am gencialh kind lo animals" 

like team gamcN latlKM than nidnidual spou^*" 
\ pietCT g<>ini: lo liie Uu)ihali li^ going lo the piclurC5»'' 
"1 am loo sh\ to give mv opinuni lo a kiige gioiip". 

Ropjodu..c i^odi seis o1 NiaicmeniN on caids which contain \>nc statcmcni each. 
Shuttle the otdoi oi ihe caids (ii\e the caid.s to a numbei of ic>pondcntN, and ask tJieni \o 
lale the Ntaicnienis m nme tudeied categone.s m !egard ti) the ijuestiim "Whuh of these 
Niaiemem> wxnild > ou nu>sJ hke pc pie to sa\ about \ou"'" The piocedmc pkicmg ilie 
siaionKNHs \u ihe nme catogoues i> de>cnbed b\ Cohen ( 1^)71 1 No nuMUii^n oi cunnsiiy is 
made, m> ih.o liie ^e^pondom^ are classit\ ing tl^e statements puiely on the degiee o( tlieii 
wial av\epiabihu The categones ate marked ! to and the mean value is calculated for 
eacii siaiemcm AiienianveK . ilie media!i c uegorv ma> be found for each statement, 

cuuosttv siatement i> then paired with a geiieraU oi "iiackgiound" state- 
mem oi equai mean (or median|N\Kiai acceptability. Tlie test of curuvsity then consists of 
the set i^f pans >taiements. winch are gucn i\) the lestees with the instiuction *'Mark the 
one oi ea^h pan thai des^ ihes \ou betiei". The sconng\^f ihe icsi is snnply a ctumt of 
the numbei of mnes that the cuhihjs statements m the paiis aie selected, 

Tiie abtne i>uihne does not gt^ nito the details oi winding and procedure, which 
would be crucial in tests of tins !vpe> h is presented as a suggestion for constructors of 
ne\\ tests in science education research to couside* :ie authors are currently attempting 
to produce a icnI of ihis i\ pe it) measure the congruence between children's and 
Scientists" beliefs of liow scientists think and act, which should be a useful instrument as 
part of a battery 1\)r evaluation i>f science curricula. 
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A TEST OF ENQUIRY SKILLS 

iiari V J, i ruscr 

Piirpiise of the Tesi 

!lw vvutih o\ M\ cvaluanon instnuncni dcpcnd> laT^eU upon iho purpose 

i lOl jlkMch'ic. ihc use to wind) lOi S jn lo he pui musi he deuiK understood. 

Ihe lUau^ u>e eu\^s.ii!ed loi lOl S jn )n ihc suwrnuxwc e\ahKinon oj ihe 
ViNiKiiuin SvKMue J duc.uiou i 1 ASl PK uiUvuhini. The speeHkaiuiUN 1\m deMgn- 

uiu !0} > ^KMJ. ncevi hdn* ^nh.isUMU \\\\\\ coulesnpoKiiv Uieoieneai eousideKiUoub in 



< urrieuhmi e\;iluation theor\ 

i M ptiipoNCN i.hiN ,iMKle ihe vOMse \n whkh ihe lonn sunuuauve curneuhnu 
ev.ihuiibsi wdl he -iscd uccd^ ^dvc claiirjed \u \\\o \\a\> I'lisiK , diseus^^ion iieie will be 
lOvtM. t,\} ^urj c\A\uA\h>n. unoUvs pupiK' aJnevcnie!U o1 desuabie gvuls, and 

wiil 1:'%'':.' A c\AhiAU^n) whkh iikIuJon o\peii^' 'i]>iniiMiN 'il' ASl'P nuiTerials, leaeherN^ 
. . lassos sii' \SI P, eu U imliet disL-u>M'>!i x^l luid jud noH evaluaiu>n 

v.i:i he \y. ! i.iN^i. h^".^ a!ui Wiuuield aud Ken. i'^'^U). 

SeeondU . vuni. ulaiu e\alu.ituMi \\\\\ fhu' he dehned Minpl\ as ilie deienuiiuiiu>n 
ot uiieiliet i>i UiM a paiueulai eurruuiuin is etJee!i\e (tu more elleeuve ^!ian an alternal- 
ne) liisiead. the denmiUMi adi'pied iiere ujl! he the ni^ue complex vme ^incn by Caru>ll 
{ \^H^>, p j;5.^)uihi vinnis 

'M u<>uld define ^inneuluni exaluauon as a process . . . o\ deterniiniug 
wUviU ob]eciuesU can auaui. \uuie! what conditions, and what 
kinds vi! pupiK ' 

} oi cuniculum evaluati n^ delmed in i!un wax . il is possible \o judge the allainnieni oJ 
objectives .^l anv cuinci-.lun) ouher ^^zainst some absolute Mandard oi against the attain- 
ment under alieinatue vi'tncbla. 

Adenninon cuniLuluni evaluation similar to tliat given above is also tenceicd 
in Vi*alber^\ mode! ( p)'^*)) winch is expjessed by: 

in this equation. Ay^ siands toi liie set oi learning outcomes, i- lor the uislruclion or 
cuniculum, .1^ tor the aptuudinal and person.^logical attributes ol the pupil and I:/, tor the 
leaiinng en\ntMiment By using such a theoretical model as a basis lor curriculum evaluation, 
it is possible nt>i onl\ to provide more useful and comprehensive information but also to 
•Vtmtnbute \o basic educational research and to the Uirmulation of verifiable principles 
and theories ol instiiiction'V <Walberg. 1 p. 185 ). 
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llio avcopuiko ti! the abtAc dciuutJim i^I cuukuIuju o\aUKUt'Mi Iun inipoiiant 

uuh UuMlonnith^n wdl lunv ho osiahhslK^J, 

SpecHicaiioiis for Ih^ TeNi 

M^^/rn/^/>)<?/)5^o/)«5/ Cnierion 

1 u^ni the above discu.sMon n l\^Uows iJiat cuiruiiluni ovaluaiu^n 5>iumld covei a 
v^'ni-^iohetiM\c lanijc oi as nian> ditlcuMH loaunng ouUiWcs .i> posMhlc. Indeed, %is 
< 50!ibavlj \ p 45) adxocaiON, ^\in ideally Miiiable baitejN io^ cvaUiaUon puipo^eb will 
iiulude scpaKiic ineaMue> o! all ouKomes , , , . e*MiMdeied mipoiiaiu" SiinilarK , Slake 
i r^o'*, p. 5.^0) has devTibed in> vi>niTnuinein 10 a niuhidinienMi> a^ enUMh)ii \if eurni.ulai 
rtiOv nvencNN h\ >aying 

' U Is a greai nushniune thai ibe heM iramcJ e\aluatoib liave been 
looking ai education un)i a niieto>e4^pe latbot than wnii 1 
paiioianuc viewtnider. ' 

} ti! ihc p^e^en^ purp<>>es \c^\ devoK^pnioni, then, n in doMrable 10 vi^nsnikt an msnu- 
nuMii uhkh pfi^vjdeN sepaiaie nieasujcs ol a uide vaiie;y <MMudent ouieomes. 

h^iportdnt Pupil Outcomes 

1\m an> euineuluni exaluaiuni niMiumeni, aii oxeiudnig ei^iMdeiaiion is thai each 
.>iiU>Mne nieai>iued nui>i be aii mipoitant i^bjeeiive in s^eienee education. ConsiOquently, 
v uinenlijni e\aluani>n siii>uld be based upiMi the giuls that a enrrieiihun tntght t(5 attain 
;allKM ihan tlioso siufcj toi that eujricuUink ll the goals j^taied toi a eurriculuni are un- 
iinpotiani. ihen then acluevenieni is no indicatiiMi o| the eJlieacy thai cumeuluin. As 
Sciiveii ( l*>b7. p.5J ) p<ijni!» out. ' it i> i^bvhuis that li goals aiOn^t worth achieving then it 
is unuUeiesting how well they are achieved". Clearly, il curnculurn evaluatiiMi is based 
\olel\ upon curMcuia'.N i>wn gi^Is. ilie curriculum deemed nuvsi ettective could simply be 
ihe one with ihe least enieiprising ^\)als. This opniii^n is siiared by Cronbach { 10^3) who 
cahnis thai 

' an ideal evaluation would include measures ol all the types oi 
pn^ficiency that might reasonably be desired in ilie area in question, 
nor juii (he selected initciMnes 10 which llie curriculum directs 
substantial attention/' 

In an attempt t<> i^btain a comprehensive statement ol all important aims in 
vience education, an extensive literature survey was cimducted. This survey included a 
s\ siemaiic scrutiny ot all articles over ihe last ten years in Science Kducaiitm, The Journal 
>yt Research in Science Teaching, and Tfie Ausrraiian Science Teachers^ J ounial aswcH 
as the large number of cri>ssMelerences !i)und in the bibliographies of these articles tx- 
amples dI important sources ot aims include Hurd ( 1969), Hurd (1970), Lombard (1965), 
XiiiiN (\)nunitiee of the Newcastle and Distriets Association ot Science Teachers ( 1967), 
Sucnce 5 13 ( 1971 ), and the NSSh Yearbooks ( 1960 and 1947). From this inerature 
- u\ey 11 was lound that Klopler s cla^^^flcaIion ot science objectives ( 1971 ) was the most 
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.on:i}MchcnM\c iMic and cnibiacod alnu^Nt all outvi>incs slated i^hcwhcrc. Fur this reason. 
KU>ptci \ Nchcmo was used to classity the outcomes listed in all uthei alius statements. 

I jhc purpi>ses t>nest construction, u was decided to restrict attention to 
Kli>pKM \ catc^ionc^ called the process savnufk uhjiury. \ um\ the liteiatute. ample 
cMdence was ci>Hccted to support the importance of these goals, which have formed the 
basis toi the devcU^pmeni ot . 1 Tesi oftnqiury Skiih The scope oi the skills measured m 
TOt^ S is sh4H\ n m Table 1 , 

TABLE 1 

Scope ot A Test of Enquiry Skills 

PART A RtHiRtNCH MATERIALS 

Skill 1 Library Usage 

Skill 2 : hidex and Table of Contents 

PART B INTtRPRETING & PRO( HSSING INFORMATION 

Skill 3 : Scales 

Skill 4 Averages, Percentages and Proportions 
Skills : Charts and Tables 
Skill 6 : Graphs 

PART C CRITICAL THINKING IN SCIENCE 

Skill 7 : Comprehesnion of Science Reading 
Skill 8 Design of Experimental Procedures 
Skill ^ : Conclusions and Generaliialions 

Aptitudes for the Enquiry Approach 

Reconsideration of Walberg s model, described above, shows that both aplitudinal 
and environmental variables are of importance in curriculum evaluation. The relevance of 
some of these variables in the case of ASEP can be inferred from the nature of the ASEP 
course. In particular it is interesting to note that the ASEP curriculum is based upon the 
enquiry apprmch <ASEP. 1^)70). With this approach the pupil is engaged predominantly in 
independent study usmg ASEP booklets to provide reading material, instructions for con- 
ducting experiments and questions to answer. Furthermore, with any approach involving 
independent pupil enquiry, it is reasonable to assume that there are a number of attitudes 
and skills that are prerequisite for success. For example, motivation to work independently 
is clearly an important aitilude in this situation. 
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In advhUvM^ ounudoN, luiwevci, the use of independent enquiry a5iiiumes pupil 
mastciy ot a Ih^si oi eognni\o skills, Toi msuukcjt is assumed that ihe suideni can inid 
iele\ani leleicnce maienals in d^e iihian and ^ran inteipiet science reading niaierial pro- 
vided It is assumed, aUo, thai siudenis can lead ihe scales o! instruments used in experi- 
ment M\\ van U'ctnd ihcu njcasuKMiKMUs u\ lahuku giaphical loruK Similaily, the 
mdepcndeiu enquiry appn^ach assumes that students have simie ability to set up apparatus, 
\o select ippitipnate msirumcnts and to diaw valid conclusions Uvm data. In \)lher words, 
the skdis liMed m I able 1 as cntena ot cuinculum elYeciivenessO»dependent variables) 
could also sene as apntudma! tdepcndent I variables alYectmg pupil achievement \)j other 
jioaK m science educain^i. For a discussum ot these duai roles played by enquiry skills, 
Kteience can he made 10 Nevvp\>it tl*^^^-)- 

I \n !he above reasons, lest 0] enquiry skills can be justit'ied m curriculum 
evaluation, not only as a ciiteiu^n measure, but also tin use as aptitudinal variables. Such 
apiuudnui vau,jblos could not mtluence pupU success on a wide variety oi\mtcomes 
but ^.otild ,i1m) iniei.ui dif feicnnaliy wuli alternanve curricula to yield \hc apiiruiiv- 
frviUmt fii innnH ai^m discus,sed by Salomon { 1*>71 ). 

Content free Outcomes 

It tme wished lo compare tiie AS1:P course with a traditional one, a pri>blem 
would imtnediaieiy arise since the cv>nteni covered in ihe iwi^ courses would be markedly 
dilYereni. Funhermore, evvn ^\ ASIP was evaluated witlunu sucli a control ^loup. tire 
problem 01 ascertaining the Cinnent covered by the AStP sample would still be acute. 
Tlie leasv^n loi this is that n is part of AStP's phiK^sophy that ditterent AShP teachers arc 
t>ee to ciioose dilJerent umi^ toi their classes whilst ditterent students within a ^ lass may 
chiiose ditterent options tVom a given unit. Consequently, in curriculum evaluation, it 
would be invalid \o insist that all students should cover identical AStP material since this 
would be alien to the way ASHP materials are intended to be used. 

One way of overcomiiig this problem of determining common content in curri- 
culum evaluation is to focus upon content-free outcomes. In curriculum evaluation then, 
content-free tests are more widely applicable than ones covering specific content. For 
this reason, an enquiry skills test would be particularly useful in curriculum evaluation 
because ot the content-free nature of such enquiry skills. 

Form 1 Level 

Because of the relatively slow clianges that would be expected in students' en- 
quiry skills (and other content free outcomes) over time, it was decided to concentrate 
ASEP evaluation at the Form 1 level. The reason for this is that the ASEP curriculum is 
likely to have more impact on Form 1 students who would have negligible prior background 
in science tlian on pupils who have had some years of experience in other science courses. 

Consequently, in writing TOtS, care is needed to ensure that items are suitable 
for the reading level and stage of development of Form 1 students. In practice, the 
difficulty of vtKabulary used in items was controlled using Gardner's list of words common* 
ly used in science (1972). 
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Sensamty oi the in^trwnent 

A deniinij: chaiacicnsHc ol cunkulum ovalu;Jt!on has been lakcu hoTo to he itb 
coiK\Mn !»M Hu^ auieiential eliec!ivcneN> ui any curncuium lor difterom Mudents. 
NC^iuciuK . n uunnon i> he iiiicv tcd \ W avlueveiueni <»i ot all ability levels, 

u IN mappionn.ne io aim ie>i nem djHu tiines at tlie ^\iveiage^^ child. Such a bias would 
tail to piovKle nUoini.iiion about the achieveineiH ot both high and low ability students, 
huioad. an msuntuent with aj pMpuaic scnMtivHy v^iuild pi*widc a wide ranginj ium 
.Ujjh uim s vonipaiihle wuh the abtin\ level ot all students in tlie lajget population. The 
Huponatue t>i iuk uide i.uigc nt ueni diHicuhv ieveU has been 5>tressed b\ Tyler < 

I ut!lKM:noK\ m dcveltipui^ M)i S. u was assumed that eacli enquin skill would 
bo nuskMcd \,u\ inu dciitees b\ dilYoient pupiK } ot example, tJie sktU o! reading a 
scale onild be tcsied at pn^^iCbsneK moie complex levek. abbhown in Fi^iuie L In this 
tij!ine, leaduje liic s<ak» at point A is relativelv eas\ . at pomt B a little harder, at point C 
>nl! nioie dutvvuli M\d at ptMiu I) tiie most dnncuh of the tour, 

Oiuu.^^ . ,^nsuuciion ui lObS, then, an impoiiant specilkation is thai eacli skill 
slhUild comatn a lanjic ot neni dilticuhies cxMnpaiible with loim J students' range ot 
jbiht\ in ejcii >ki11 In piactue. tins wjs attempted both b\ uiierviewing Form 1 students 
and b\ ohtauuni: ihc sub)eLTivc judgement' «>t expenenced l oim 1 teachers. 

B A C I) 
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Multiple Choice Format 

The delinmon ot eurnculum evaluation employed eailicr stipulated both ihc use 
of J multidimensional cntenon and consideration of apntudinal and environmental vari- 
ablev The impiomeniation of such an approach to curriculum evaluation, iiowever, incurs 
considerable expendmiro m tesi adnnnisirahon and m analysis. For this reason, it was 
decided to use multiple choue formal for the test so as to economise on testing and 
correction time. 

Once ihe decision li) employ multiple-chiMce tests is made, however, it is import- 
ant to differeniiaie clearly between the ami} tical mode and the tonstmctiYe mode 
described by Schwab ( p.473). The analytical mode of testing could require Che 
student to mterprei a graph, to '^'lect l>t>m alternative hypotheses, or \o choi>se the best 
of alternative expenmctiial set- jps. Clearly, mulnple-choice testing is appropriate for 
measuring all these skills m an; lytical mtnle. On the other hand, however, the same skills 
tested m the constiuctjvc mod? W4»uld require a student to construct a graph, to form his 
own hypotheses or u^ describe ayi appropriate experimental set-up. Clearly, multiple- 
dunce Items camuM measure those skills in the constructive mode, Consrquently. when 
interpreting results i»btamed Using TOtS, it is imptirtant to appreciate that data were 
obtained h>r the anaU tual mode and ate not necessarily generalizable to the constructive 
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nu\k NcvcniiciosN. n is icasibio thai poiioinunco m the ^in.^Ktkal nu\k vouki bo \n^h\\ 
icuucd to that \\\ Uu* vonstiucino. \h\s quosUotK Iuuvc^lm, icvjiuics luMhcj ujNOsnii^iUon, 

Dovdopm^ui of the uial version 

In wnnng the tiial voision TOI S. mvjs\uc\ \\C}c lakcn lo onsuio iho 
\a!uin> Items and ti^en Mniahihiv jt \Uc l-oini 1 level Fum1\, extoiisue u>e was made 
-I xhc hiciaturo both lo v3aul\ iho moainng and bCi>pe ol each >ki!l and io be suie ihai 
ca. h nem nuMsuied an objective inipt^iiam in vience education 

SectMidh , an extenMvo leview o! botli published and unpublished evaiuanon ui- 
Ntiunicnts was u>ed a> a souue o\ ideas \o\ Ws\ iieniN> iixan^ploN i^l tests that ptoved 
useiul lof this puipose aic tht^se developed b\ the New South W ales Depaitmcnt ot vdti- 
vation i 1*^<>3). ScicMiec Research Assivtates ( ^)5bi Nelson { I'^k^ll Rescatch ai^d ( urn- 
vuluni Branch m Queensland \ Ausiialian Science bducaiioi^ pK^jev t ( IM?: 

i.aidnci i h^h^K Bii^logical Sciences l unicuhiin Study { VH^ll Diessel .o d Maxliew (1^)54) 
I mdvjuist i P»52), MoTse and McCune ( ]^Ji>4) and Waison and Glasci { r ) 

ThiidK , all ueius wiuien ueic \ub]ected \o ihe scrutiny <if a } and i^l expeits in 
oducanonal measurement and in science education. By means ot these panel sessions, ilie 
laa* \ahdit\ oi horns was checked to ensuio thai each item did measure the skill lo which 
u was allocated, that uen^swero suitable iox the }'orm ! ability range and tliai items were 
well constructed and !iee ot clues i>r ambigunios. 

The 1 17 iienis winch survived the panel sessions wete then assembled into a trial 
baTtor\ and administered to 14 Melbourne Form 1 classes, each iVimi a diOercni schooL 
In each i^t these classes, a random third of the class sat tor Part A oi the battery* another 
random third took Part B and the rest of each class ttuik Part C. Furthermore* in order to 
prevent fatigue, the test administration was spread over two class periods occurnnj;, on 
different days. 

Finally, in order to illustrate the nature of the items included in TOES an 
example of one item from each of the nine skills is given in the Appendix. 

Statistical analysis of the trial version 

Tests as a Whole 

Table 2 shows data for the battery as a whole, including the sample si/c, the 
number of test items, the mean and standard deviation and the Kuder-Richardson 20 re- 
liability of each part i)f ttie test and each individual skill in the battery. 

For all tests in the battery, with the exccpti*)n of Skills 3 and 5, it was found 
tliat satisfacti>ry sensitivity had been achieved. Thai is. except for two skills, each test had 
a satisfactory spread of item difficulties ranging from very easy to very hard. On the other 
hand, for both Skills 3 and 5. the tests were found to be insensitive fi>r measurements t>f 
higli pioficiency since 28 of the 29 items in these tests were correctly answered by at least 
60 peicent 4)f students, Tlic reason for this occurrence was that, during item-writing, the 



cunein level oi Vouu 1 pupils pjotkicncy m ihObC skills had been under-estimaicd. In order 
lo ubiain icsib with appr<>pnalc sen^itivuv Iot ihci^ slalh. n will bo neccsjiary \o rowrue 

lesis adding a number ot more dittUuli iteniji. lo administer ihe new version lo a sample 
ot pxmh and then to analyze tlie new data. 

TABLE 2 



Statistics for Tests as a Whole 



lONi 


Nunibi'f ol 


Number of 
n^tns ' 




Deviation 


K 

Ur1i:ibi1itv 


Skill \ 


151 


15 


c^,<b(57';) 


2-4 


0.5J 


Skill : 


J5l 


11 


7.8(71'") 


2.4 


U.70 


All Part A 


151 




16.4(63'^) 


4.2 


0.74 


bkui 3 


1 Al 


1 o 






0.74 


Skill 4 


147 


9 


4 3 (48';? ) 


2.7 


0.83 


Skill 5 


147 


16 


13.7(86'-r) 


2-4 


0.73 


Skill b 


147 


15 


9.3(62'1) 


3.5 


0.79 


All Part B 


147 


53 


37.1 (70%) : 


9.5 


0.92 


Skill 7 


13h 


15 


10.5 (707r) 


2.7 


0.72 


Skill 8 


134 


10 


5.7(57'7f) 


1.8 


0.46 


Skill 9 


134 


13 


7.0 (547p) 




0.54 


All Pan C 


134 


38 


23.1 (61%) 


5.3 


0.78 



Finally, since it is assumed that each test in the battery does measure a unique 
skilK it is important that each lest his reasonable internal consistency, as indicated by its 
Xuder-Richardson 20 reliabihty. Nevertheless. must also be appreciated that the size 
of the K Rj^j reliability is restricted by the sliortness of each skill test. Since the 
dctinition used here for curriculum evaluation stipulates a multidimensional criterion, 
TOtS has been designed lo maximize the number of separate skills whilst practical con- 
siderations have limited the length of each skill test to 10 to 15 items. Furthermore, since 
TOES is designed to measure group performance, a much lower K -R^^ reliability is 
acceptable than fi>r tests used to discriminate among individuals. 

Based on the reasons outlined above, it was decided that values above 0.50 wc\:M 
be accepted for the K -R^^ reliabiHty of each skill in TOiiS. Examination of the K-R^^ 
data provided in Table 2 shows that a value above 0.50 was obtained for all skills except 
Skill 8. Nevertheless, upon removal Irom Skill 8 of ae two items that were not signific- 
antly correlated with the skii: total, the value of the K R^^ reliabiHty for this skill did 
rise above 0.50. Consequently, for the purposes for which TOES was designed, all skills 
hac? .K. -ptable K R^^, reliability. 
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Tabic 3 provides some siatisucs foi each of ihe nine ic>it ucim shown in ihe 
Appendix, The dai*i inchide liie peicentage of studenLs vonect, xiw pomhbiscxvdl cone- 
lauon x^i ead^ item with iIn te.st Pan logeihei wu!i hs Mgnjlkaiwe level and tlie conelatu^n 
of each item with all skills within its Part of the battery. 1 he e\Mielaiiinis for each ueni 
a^e unbiassed m tiiat the\ were calculated alter thai paiticular uem had been removed. 
Also. The correiatiotis of nenis v%ini each skill have been corrected tor attenuation to 
accxnmi itu the variation m reliabihty between ditVerent skill tests. 



TABLE 3 
Statistics for Individual Items 









■ l"i>rriv« 


In biassed 
lOrreljlion 
\vu}> >'jit 


P 


tJnbiasM'd CoTrtlaU.in* 
wilh Skill.s 


\ 


1 


3 


57 


0.33 


0.0001 


Skill 1 Skill 2 

0.39 0.36 


A 




1^) 


n: 


0.45 


0.0001 


0.47 0.54 


B 




35 


65 


0.55 


0.000! 


Skill 3 Skill 4 Skill 5 Skill 6 

0.63 0.53 0.49 0.47 


B 


4 


40 


46 


0.51 


0.0001 


0.50 0.69 0.39 0.43 


B 


5 


57 


89 


0.26 


0.001 


0.21 0.18. 0.40 0.25 


B 


<) 


71 ! 


58 


039 


0.0001 


0.35 0.38 0.29 0.43 




7 


87 


79 


0.46 


0.0001 


Skill 7 Skill a Skill 9 

0.65 0.28 0.41 


( 


.S 


10! 


84 


0.28 


0.001 


0.28 0.43 0.18 


C 


9 


106 


50 


0.14 


0.05 


0.08 -0.06 0.40 



* rtiestr correlations have been irorrt^ctcd for attenuation. 



Tlie data in Table ^ can be used in three ways to guide the writing of a final 
versu^n i^f TOES, Firsily , where a skill test has numerous items of the same difficulty 
level, the renewal of some of these items would reduce lesi length without adversely 
affecting the test's sensitivity. Secondly, sirKe each test is intended to measure a unique 
skill, the construct validity of each test can be improved by removing each item not 
significantly correlated with both the skill and Part to which it belongs. Thirdly, if an 
Item is located within the correct skilU its correlation with its own skill shoulu be larger 
than its correlation with any other skills contained in the same test^art. Consequently, 
the removal of any item that diverges much from this criterion would also strengthen 
the construct vaUdity of a skill test. 
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Writing the final version 

Fium Uio prcMouN vJincunmimk a Mimman can now be made ol bUgfesnon^ lo guide 
iho icxMiung ill Wi s } UNiK . ihc twu ^kl^l tosu with mappropriaie scnsuivitv will need 
lo ho Knvuttcn. adnnniMoied agan) and ic ana!>/od. ScoMidlv , io iinptove CDnhUucl valid- 
i!> . n l^ ad\l^Jble to icmove thoNe iicim whuh aic euhei not signilkamly vottdaied with 
lc^^^ a> a whole v\hoNC anieiaUon i> hi^iiici wnh oihei skills in ihc baiteiy ihan wiih ns 
tnvn skill Once uenis au' ioinu\od Iioin umn. iiowevei , a i:^ desirable lo aseoiiain ibe new 
siatiMual viia!acieti>iKN <>Vihebanei\ b> ic-analv/ing ma! daia atioi ihosc u ems have 
been jonvAed 

} ihe Heni> tiiai loniam atic? ippKnie ibe piocedureb ab^ne, vmU> very minor 
vhaniies >h^ui!d bo made ni woidnij!, laboilmu diagiani^ or choice ot dj>iiacu>i>. These 
nnnoj ciunee> ^.onld bo based upvMi Uie opmuniN o\ nieasUienuMU expens whv^ liave scruiui- 
i/ed lOl S, mi'^nnaii'Mi obtained b\ unorviowing the suideni> who uialled iOliS.or Ironi 
'he di>njvr 'f .nui]vsi> ii^ni the .idnnniNuaiuni t^t TOI S. 
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APPENDIX - SAMPLE TEST ITEMS 

SkiH f Library Usage 

Figuic 1 below sliows copies tit" several pages from a dicuunaix , I'so these to aiiswci 
OueMions 3 t>. 

FIGURE 1 

hlSKY 530 id- 

le ICLt 531 IDLE 

IDOL 532 ILLATION 

ILLEGAL 533 IMITATION 

IMMATURH 534 IMMUNE 

immature, a., not mature. 

immediate, a., having no intervening medium; occurring 
at once. 

immemorable. a., not memorable, 
immemorial, a., ancient beyond memory, 
immense, a., vast, huge; (si.) very good, 
immerse, v., dip or plunge into hquid. 

immigrant, n., one who settles in a new country. 

imminent, a,, impending, about to occur, 
immiscible, a., cannot be mixed. 
— — immobile, a., immovable; motionless, 
immune, a., secure; exempt. 

3, On which dictionary page in Figure 1 would you find the wo.d "igloo"? 

Page 530 
Page 531 
Page 532 
Page 533 

None of the above 
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A 
B 

C 
D 
E 
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SkiU 2 : Index and Taole of Contents 

TABLE OF CONTENTS 

CHAfTEfl ^^^^ 

\ ARRIVAL 01 TUl ABORlCiNHS 5 

The Jouiney to Australia 5 

Lady Tubal Aicas ^ 

Adapting tv> the Envuonmcnt 9 

: ARRIVAL OF THL WHITK MAN 1 1 

TicatnuMU i^i Ahotigines by Wlute Man 1 1 

Rcacnon ol Aborigincj^ tu While Man 15 

DISTINGLISHING BtTWHEN TRIBLS 17 

Aioa> nl ScitlenKMU 18 

Language ^0 

Huntnig Grounds 21 

DilfeivMKVs m Laws 22 

4 I NDLRS I ANDIM; ABORIGINAL ATTITl DtS 25 

Class Snucturt: 26 

Marriage ^ 

Illness 34 

Death 39 

5 ABORIGINAL CUST .MS 45 

Inilialion Ceremonies 45 

Corroborees 49 

Walkabouts 52 

Religion 56 

6 ABORIGINAL CRAFTSMANSHIP 58 

Paintings 

Making Tools tor Food Gathering 66 

Aboriginal Musical Instruments 69 

7 ABORIGINES TODAY 79 

How and Where They L 2 Today ^0 

Famous Aborigines 83 

Attitudes of the Government ^. 85 

19. Information about tvonnc Gooiagong (the well-known tennis player) would be found 
in 
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A 


Chapter 1. 


B 


Chapters. 


C 


Chapter 4. 


D 


Chapter 6. 


E 


Chapter 7, 



SkiUJ Scales 



BUX K 



10 



30 



40 



50 



CliNTIMtTRlS 



1 1)0 length i^\ {he block ot" uood in Figufo 1 3 is 

A 25 ceniinieires. 

B 20 centimetres. 

C 1 5 ccntimotrcs. 

D 30 centinieires. 

H 35 centimelrcs. 



SkiU 4 Averages. Percentages and Prooortions 

In a tootbai] match the winning team kicked a total of 20 goals. The names of the 4 goal- 
kickers together with the number of goals kicked by each person are shown below. 

Name of Goal-kicker Number of Goals Kicked 

Jim 
Bill 
Alex 
Jack 

20 

Use this information to answer Questions 40 46 below. 



10 

5 
3 



40. The average (mean) number of goals kicked by Jim. Bill. Alex and Jack was 

A 4 

B S 

C 6 

D 10 

Er|c e 20 



Skili 5 Charts and Tables 



^1 



CRIME IN AUSTRALIA 

Statistics for house burglaries 
for years 1967 and 1969 
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"7. Which state had 500 burglaries in 1967? 

A Tasmania 
B 
C 
D 
E 
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South Australia 
Victoria 

Western Australia 
Queensland 



Ibo jiKij^ii bcKnv ihiN been duuvn tjom inhunianojj tibtamt^d dunng a sctiCN of cai U*Ms ai 
ViUvlxAMi 1? nIuasn UiO Npood ot u\o caiN at dilYorcnt nmos, L se this giapJi lo answei 




TIMF AFTtR START OF RACE (SHCONDS) 



7 1 . Afier 60 seci>nds. the speed of ihe falcon GT. 

A is greater than the speed of !he Holden Monaro. 

B is less 'han the speed of the Holden Monaro. 

C is equal to the speed of ^he Hojden Monaro. 

D cannot be predicted from the graph. 
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ShH 7 . Cvtn^re^ension of SaerKiS Heading 



Par 1 Dki \ou kmn\ ihat nun\ hud Nongs Jie not lot \hc onjoymeiu of man but a 

jncan> ot idling oihc! buds to slay away ? Bctoic selecting a temale for a mate 
ihe male bud NUikes out a icrnuny . He di)cs ihi^ by *ighung wuh, and chas- 
ing oui. t^thci bud> liom ihc choNcn area. 



Pdf 2 Attei a maie i> sckvicd a ncM i,s buih bv liic pau buds and eggs are laid 
b\ \\k female rsuailx ii in the m<uhet bud thai keeps the eggs warm. She 
Mis on the ncM tot nian\ days wh:ie tlie eggs ate incubating. 



Par ^ Dui ng ilie lirsi lew weeks attei the younji buds hatch they eat a huge amount 
ot tood. ] he pilot paieni buds are kept no huNy tlvmg long distances to 
collect suuable food th.M ihe\ get very thin. 



Pur 4 The \oung bud which hatches lust gets mosi o\ the Un^d, grows taster and 
ma\ even pu.Nh oihei v vumg buds out t>f tiie nest. 



/V 5 While on die ground tlie tiedghngs are quicklv eaten by enemies such as owls 
and cats. 



Par ^ Some parent buds overCiMue the food problem by collecting and stiutng food 
fiu a few days helore tiie eggs are due ti) hatch. 



Par 7 One such bird is the crested bellbird. These buds collei.t caterpillars, cripple 
them and place them i)n the branches of a tree near tlie nest. 



H7. The way a bud claims its living area is described in 

A Paragraph 1. 

B Paragraph 2. 

C Paragraph 4. 

D Paragraph 5. 

t Paragraph 6. 



*>4 



SkiN 8 Design of ixpenment^t Procedures 



Below avo tno CiMUjincis which can be used tor nioasurjng annnmis ot" hijuid 



B 



D 



50 ml 



10 ml 



:50 ml 



- 100 ml 



500 ml 



1 

1 



Which of the abuve containers would he ihc most accurate tor you to use tu measure 
5 inilhhtres of water? 



A 
B 
C 
D 
E 



Container A 
Container B 
Container C 
Container D 
Container E 



Skill 9 : Conclusions and GeneraliMtions 

106. The builder says: '*Some Zanians live in round houses. Those people over there 
are Zanian$'\ 

Which one of the statements below folU)ws from what the builder said? 



A Those people must live in round houses. 

B Those people could not live in round houses. 

C We don't know whether those people live in 
round houses or not. f 



FROM THE TWO CULTURES TO MONEY: 
TRENDS IN ENROLMENT IN HSC SUBJECTS IN VICTORIA 

H i Whiiv 

I he phKisC 'ihfiu ScKmkv*' h^N been cunciu cvei smcv the publication of 
du* IXmuon icpou i l^H^si wluch thai in Britain the numbers of students in upper 

sevond.ux vJ,uuiMUil\umscuMKv au.Iu!!:::^, Shor:h ufier !hc :op-rt appeared there 
weic scxcKil nuesu^ation.N whether theic was a ;»unilar trend in Australia tMackay 1968; 
Ihonrio^n hM>N.V\hite SirankN 1^)0*^ Fenshain 1^)70), The ctniclusioirs u1 these 

studies doicjcd \o A dcproe. be<:auso oi ihc dilYcrent methods erupluyctl to iJentify any 
tall in popuianrv o! Science, but in general it was clear thai \i there were any trend at all 
a>xa\ liom Science tlieu it was nowhere tiear as severe a^m Britain. Because there may have 
been a viiange in ihc AuMiahan Mtualion since the tust group ot studies. \\m paper pre- 
sents an updated rcp*Mi enfiVUKMits t\n the Higher School Ceriitlcate ilornierly Matric* 
ulation ) cxanunanon m ' k ti>ua No llgures are presented tor other Stales, Sheedy 
U'H^jhasa vonipaiabie.bul not exaclK parallel, set o! data tor Now South Wales, Since 
t lends ui enri>huent have nnpunani iinpiicalions lor administrators, curriculum Construct- 
tns. teacher^, and tiie pubHc in gcfieral. u is hiiped that tins paper will stimulate the 
eviiactiMii \y\ cunespondmg figures tor ilie rest the ("ommonwealih, 

ConcluMoiis about trends in enrolment are. to some extent, dependent on the in- 
dex used to measure the nend. Several indices have been used in earlie studies. Their 
iiuplications are discussed below. 

School or university enrolmenis? 

When one is ii> irig to check whether there has been a decHne in popularity of 
Science as a field ot study, all of junior secondary , senior secondary, and undergraduate 
enrolments may seem appropriate for investigation. All suffer from disadvantages. At 
junior secondary level few students have a wide range of choice of their curriculum: the 
decisions are made fox them by the school, overtly or covertly. Enrolments in subjects at 
junior secondary level arc determined by administrators, not by students. Undergraduate 
enrolments are similarly directly determined by bureaucratic decision in Victoria, where 
foi many years quotas have been applied to all univeisiiy faculties. Thornton (1968) and 
Stranks (1%^^ ) included university enrolments in their discussions, but, as measures of 
popularity of subjects, enrolments and the concomitant figure, number of degrees awarded, 
are invalid. 

Greatest freedom of choice exists in upper secondaiy school, though quotas have 
an indirect effect here. If students perceive that it is very difficult to enter a Science or 
Science-based faculty such as Medicine or tngineering, then many will prefer to aim at an 
easier target by studying non-Science subjects in their final school years. 

None of junior secondary , senior secondary, or university enrolments is entirely 
satisfactory as a measure of trends in popularity of subject areas, whert factors outside the 
^ intrinsic appeal of the subjects are to be excluded, but because the greatest element of free 
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The fnst chowo js lo %>pefaio on ncihoi secoiijaiy school ciuolnicni^. m this case 
the lUJinhcMs cinoUcd tor the Higlici Sclioi^! < crtua jtv cxaniJtuiluMi \n Vk lona> The iiexi 
choice IN bciwccn absoiuie nuinheis, ivlau\e piopoi uous. and piopoumns o! tlie lelcvaiu 
populaiuMK chiMMn^ each \ubjeci 



Absolute numbers 

Because the populaiion i> grownig, ahsoluie munheis siud\ing eacli subject can 
be expected to U)ciease> Theie is also a geueial nend toi people * . sta> longer at 
sch\>v^L which alsi> should iiicrease the siibjeci enivihnents, Iheieioie. n is only v hen the 
populanix ot a subject is ni marked dechne thai liie nuiubeis enrolled tot tt will tall, and 
tMU\ then uUi absi>lute numbers provide a clear and u^ietul index. This wa>i tlie case Un 
Suen^e \n Brnain Ironi 1%4 on. and was the cause tor the widespread concern geneiaied 
b\ tlie DanutMi lepori. Vp to l^)t>8, when the earher Australian invesnii;i;ions weie c iuicd 
out. there was uo such fall in absolute numbers in this countiy. The VKtoHaii ligures 
suice then sijow that there ue still increasing :unnbers enrolled hu Svience subjects. Table 
I twhicf] Is >hnwn as a grapli in t^igure 1 ) cuntairts the cimiparative tijiures for tngland and 
Wales and Victtiria The Bniish figures aie tor fust year 6th ior»ri. and derived tioni in* 
loimantin given on page t^l the DainttMi leport. The sum of enrolments Um Highei Sch\)oi 
(\Mtitlcate Physics and Biology <VT\S.t.B. l<)64T^74Hs used in the Vict nian tlgures. 
T his Would seem a reasonable index, for tew students take both subjects; their total 
sluniid give J fairly consistent relative measure of the popularity of science subjects so long 
as otlier factors remain constant. It would not. for instance, be a sensible measure if a new 
science subject were introduced. No changes likely to affect the use of this index appear 
to h * e iKcurred in the decade coveted by Table 1 



TABLE 1 

Numbers of students in science courses in 6th form, 
relative to 1962 enrolment 



EngiAnd 
Victoria 



1962 


1963 


1964 


1965 


1966 


1967 


1968 


1969 


1970 


1971 


1972 


1.000 
1.000 


1.100 
1.112 


1.220 
1.373 


1.174 
1.520 


1.148 
1.620 


1.117 
1.687 


1.059 
1.916 


2.300 


2613 


2.721 


2.783 



Since the ab.^olute numbers enrolled ftu Scie^-x subjects in Victoria are increasing 
at the same tune us the population j< increasing. Utile more can be deduced from Table 1 
than that there is not so severe a flight from Science in Victoria as there is in Britain, if 
there is any flight a! all An index independent of the growth in population is needed be- 
fore mijre information can be obtamed from the etuv^lmcnt figures. 



Relative proportions 

The relative popularities of subjects are independent of growth in population. 
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3 . 



Victori' 




England & Wales 



1962 63 61* 65 66 67 68 69 70 71 72 

Fig. 1. Wucbers of students in science courses in sixth form, 
relative to I962 numbers. 



1»0 



30 



20 



10 




-L. 



0 \ 1 1 « »■ 

1959 60 61 62 63 6U 65 66 67 68 69 70 71 72 

2, Victorian sixth form enrolments as a percentage of fourth form 
enrolaents tvo year* earlier* 



\Luka\ pioUuvcd giaplKoi du^ Ikkuoik Un each suhfccK of Uic nuiuhci cni*4ied 

UH ihe subjCvi divu' h\ the nu^i^bci o! NUaJojus ensoiiod ioi \hc whole Matneuianon 
oxammatuMV The weakness oi lelatne piopornons is ti^at ihe> do no\ lake m\o aeciumt 
shuts m the l\pe o! p^*puLaiou enleuuii swth lornv Where ihe shill can he idennikd and 
measured, allowance can be made, ^oi e\ imple, Uieio has been a shut m jnopoinon 
males and kmales. Table 2 twinch is shown as a graph m Tigme i siiows ihe conipaiaiue- 
K iiieat uKjease m proportion ot gnis s!a\mg at school Ihe tk'uies weie detned horn 
tables supphed bv ih? l\Mnmonweahh Bureau of Census and Stausucs { 1^>(>0^ I'-^IM 
Dnfeicni preleienccs of the iexe^ for different subjects mav cause ihis shift lo produce a 
faii ui relatixe populainy i^f some subjects, such as Physics, that have never been pi^pular 
with gu!s» and a nse for otheis. such as Bu^U^gy, Because of this. Mackay presented sepai* 
ate results for the two soxes. 



TABLE 2 

Victorian 6th form enrolments a$ a percentage of 
4th form enrolments two years earlier 



1959 ! 1<)60 i 19t ' 1062 1 1063 1964 


1965 
1 


1966 


1967 


196fi 


1969 


1970 


1971 


19^2 


! ! 

33.0 , 33.3 » 35,1 j 37 2 37.3 

21.1 122,6 ^ 24,7 ' 26,2 29.3 


3l&,5 
28 5 


36,4 
299 


37,6 
31.2 


37.3 
30,2 


37.8 
33.2 


39.6 
36.9 


40.6 
38.5 


40.3 
39.7 


41.2 
40.4 



Mackav s results showed that between 1959 and 1967, fur both males and females, 
there was a decline in the relative proportions studying physical science and French, and a 
nse ioT Biolog>^ and Geography, These trends could, howeve^. be due to shifts in the type 
of population other than in proportions of lire sexes. For instance, as the proportion in 
the populatii)n of sixteen and seventeen year olds remaining to sbtth form increases, it can 
be expected that the fraction of less able students will icnrcasc (apart from other changes 
such as tlu proportions of people from different econon.ic t)ackgrounds). It has been 
s!u)wn that hi the past the Sciences attracted the more able students <A,C.E-R. 1964), so 
it could be expected that as more people seek education a lower proportion of those re- 
maining at school will choose the present science subjects. 

Changes such as general ability in the sixth-form population are not easily allow- 
ed for when using relative proportions, but become irrelevant vhen the proportions of the 
maximum possible sixth form population are calculated and compared for each subject. 

Proportions of the relevant population 

Calculation of this mdex is made difficult by the lack of accurate figures for the 
number of people who could have been in sixth form in any one year hrd they all stayed 
on at schin>l. Toial numbers in. say, the seventeen year old age group are not satisfactory 
because the relation between this figure and the possible sixth form population, which 
would include a spread of ages, is unknown, and may vary with time because of changed 
admission policies in primary schools long before. Perhaps the most reasonable estimate 
O „ based readiU available figures is the total enrolment two years earlier in form four Use 
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this hguic lo CNUnhilo ihc tnaxiiuuin posMhIo MXlh foim pupulatum assumes ihul ihe 
propoiiion sia\ing on tu lomUi loun icnuuns loasimahly couiitani trom yeai u^ycar, !t 
wiHild hv saJei use ihud lonn liguics ihico vcars^ carhci.oj iHst lonu !igutcs five years 
eaihoK hut iticsc do uot seem to he aNailahie. I ^sc oJ' the Umxxh form figure alsi) assumes 
ihai \hc uumheis ol nuiuie age, receiu^jnnmgiant. and jepeating candidale^^ are either 
neahiiihle oj aie \u piopnttjou ti^c ?otal eiuolment. ^hich can probably bo accepted as 
reasonabh hkeK, One JuuIkm assuiuptu^n is involved m the figures presented below in 
Table 5. In cunsidenng xhc piiipouion who go on to Higher School Certificate in Vicioria> 
n would be pteteiable u emolments m hnms tout in high schools and private schools otily 
weie Used, suue veiv f?w technical schiM>l students enter !oi this exanun^^Mon. Pt^ssibly 
sepaiate totals h\th. piuate. atui technical schi^ols e\?st, but only the combined total 
x\as .nadable at the tune wutmg lis use in the construction oi Table 3 (which is shown 
as a gjaph \n fiiiuie 5) a>sumes a ie!au\e\ constant latio between technical school and 
liUal eiuohnents m ioun lour fjom one veai lo the next. 

In vonsiTucung Talkie 3. the numbeis enrolled in the subjects weie taken from the 
X'lcionan rnnctsiucs a nd Schools fAammaiions Board Handbooks n^58>H74), and the 
nuntbeis m u\u ih ioun weie taken \um the Schools publications ofthe Commonwealth 
Huieau * <\mmk and Statistics t h?5^^ h>73). 

On the 3^)>t> ^>(vS ligute> ot Table 3. White { 1%^)) argued tiiat lor boys there 
was no cMdence ol a llight iVom science, l-ntil then tlie Physics and Biology figures showed 
an elfe:ti\cl\ Cimstant attraction by tliese subjects. SiiKe t!ion a change has occurred. In 
1^)7: PhvMcs Nufteied a serious decline; so great was this decline that the absolute numbers 
choiMiig Physics fell while the population rose. Biology, in contrast, showed a marked 
Use, The same features can be seen m the graphs for girls, tiiough the downturn for Physics 
is not so ^e\ere. and the rise in Biology, which has been going on since I960, is even more 
spectaculai than toi boys. White also atgued that for boys Literature and French had 
suffered a serivnis decline. The decline has been arrested \ox Literature, while French has 
faded awjv to a ver\ !ninor subject witli pn>speeis of following Latin into oblivion. For 
girls the same seriims decline can be seen i\n French; Literature, except in tlie last year, 
has Cimtinucd to grow and remains the most popular subject iMher than English. The rise 
m (ieography, which was apparent up io 1%8. tiow seems to be reversing. What White 
i 1^)6^) ) called the most striking feature of enrolments up lo 1968, the surge in Economics 
and the subjects likely to be associated with it. Scxial Studies and Accounting, is even more 
marked. Physics, which was for a long time the im^st popular subject for boys, has been 
passed b\ Lcnnomics. The ttM;'^ eniolment for boys and girls m Serial Studies leapt by 407c 
in 1972. Accounting has risen from an insignificant subject to pass Literature, and, if 
present trends arc maintained, will sotm be more popular than Geography for boys. 

These figures sh4>w that there has not been a High* from science in Victoria, but 
there has been a mai' ed change in enrolment within the sciences from physical science 
tthe figures for Chemistry are closely parallel with Physics) to bi(>logical science; that there 
has not been a swing to the humanities; but there has been a niarked flight to commence. 

It IS not the purpose of this paper to identify causes of these trends. However, it 
may be usetui \o suggest stnne possible causes, which are open Wn future researchers ti> 
invesiigaie. 
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195 1 57 58 59 60 61 62 63 61 65 66 67 60 69 70 71 72 



n^* 3* Entriea for HSC aubjects m • p«rc#ntaec of «nrolr»nt« in fourth 
two yesr» earlier* 



\ \\u\\ JnUhcn nUNhi^ on M schooh. and ihm laiger sixth forms, schools 
ate nuno able to esiahh^^h classes m subjects such as Biology . wlHch were previously un^ 
vcouonuc to jun 

2 Mo!e lea^heis ol Bu^li^g\ . l;ct)ttonucs. and Accounting have appeared in 

swhiHjls, 

.V Itic gcMcui tiend m the contmunity away t>om authoritarianism has caused 
a lack of s\ mpath> with subjects >uch as Physics and French that are perceived as rigorous 

4 i'hi^KO o\ subieciN is largely detemnned by perceptions of how difficuU the 
Mlb|ect^ aK\ and iheie is a gtowjng tendency \o seek the easiest subjects. 

5. SnbKVt ch*>tcc determuK^d by employment plans, and these have changed 
because puhbcUv eiven to failure of physical science graduates to lind suitable positions. 

<v Subioci chi>tce is detei ruined by experiences in junior forms, and the loss ol 
pi^pulantx ol PhvMcs t and Chemistry ant^ tlic mathematics subjectsMs atrributabk to the 
persistent shoiuge t^i quahtied and expenenced teachers of thes.^ subjects. 

U muM be sucsNcd again that these aie hypoiiieses only, and do not necessarily 
retleci ihe opinion of the wtuer. 

Ihe trends that have been identified, and their possible causes <whatcver they may 
beK pose u number of questuMis tor tl;e community. Answers to the questions wrill be a 
matter of opinion, but it is preferable that opinions are formed after consideration, and that 
a CiMisensus should be reached if possible. It should at least be discussed whether the trends 
are in the Cimimunitv s best interests, rather than to allow Changes to occur unconsidered 
and unremarked. Althougli n is not intended to give or imply answers to any of the 
questions that may be i^f interest, it may be useful to list some possible questions below. 

1 Is it desirable for growth to occur in neither of the **two cultures" while 
rapid growth ^Kcurs in subjects outside their scope? 

2. Is It satisfactory for about one boy in six and one girl in twenty to be study- 
ing Physics at 6th fimn level? 

3. Should generalist subjects like Social Studies be encouraged? Should there 
be a scientific counterpart? 

4. Are en4)ugh students studying Literature? 

5 . Is it desirable that hardly any boys and very few girls are studying a foreign 
language at sixth form? 

6. What changes should tertiary institutions make in their practices in con- 
sequence t>f these i*^ends? 
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M I R ^Sur\c\ ol goncral ahihu o1 pupils in loims 4, 5 and b o1 Vicionan j^econdan 

C'onimutcc ' J nqun\ inio liic flow ol\anUidaic^ m i^ckncc and uvhiu>iogy uuu 
hmhci oducaux»n ttnai tepoif H M,S,0. Cmu*^ 354 L 

I onsham, P J Vhc piavC ot science in AuMialian cduc;!Moir, Svanii 70, 2S 33. 

MaAa\ I 1) ''t molmenis hn Fh\MCs m Victona 1^)5^M^ o7'\ Unpubhshod, l^'aculty of 
hducaiuMK Monash I'nnciMty, 

>nccd\. 1 J ^\\spcciso! ihe N\\ing tTOin science' !n New South Wales", Unpublished 
\1 I d ihesrs. University ot Newcastle. 1^372. 

Mianks. O R, * Diifts tuw xhe Sciences \ Stanhope Oration, ConasiaXVUK Adelaide 
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CONTENT ATJALYS1S AS A TECHNIQUE FOR DETERMINING THE 
STRUCTURE OF TEXT MATERIALS 

Briatt H' Cam 

Introduction 

The ongui i>! Hus developnieiu stems inm\ a projeci which was fotided by The U.S. 
Otfut? of I ducanon «j l^bH called Cogniuvc Memory, This was an imcrdiscipUnary pro- 
ject based m tlie Cooidnuicd Science l aboratory of the University of lUinois. The main 
aims of ilus project were to develop the software for the retrieval of information from a 
large, generalised data bank. This was m>t to be rctrjcval in the normal sense of the word 
however, wiiere the entire data bank was to be searched in an exhaustive manner in order 
t*> llnd the pieces of information that were required. Rather, an attcnipt was made to 
develop a Neauh stiaiegv which would simulate in some way, the way in which human be- 
ings letncve mformati»>n from iheir own memories. Obviously the speed with which a 
human can remember" a given fact (in about 0,1 second) precludes any possibility of 
carrying out a cnipkMe .search of all of his iO* neurons. Individual facts after having been 
jsMnnlatod h> the hram arc linked into associative structures and signposted in such a way 
that letrieval oi a fact, also allows retrieval of a mass of associated information. The 
Cognitive Memory pri^ject made an attempt to understand how to stinre information in a 
data bank so ihat it was automatically signposted. 

Although a considerable amount of research effort is being devoted to this very 
pn»blem by a number of research teams, little real headway has been made because of 
the difficulty tn relating written symbols to meaning without ambiguity. Results arc 
encouraging, but an operating system is still a long way off. 

My particular area of interest in the Cognitive Memory project had been in the use 
of word frequencies as a means of Content Analysis, and it was this background that was 
used as a starting point for this project. 

The basic assumption upon which this analysis is based is that there exists 
sufHcient meaning within selected words of a piece of text, and their relative distribution 
and location to determine major themes. In other words, it is necessary to generate the 
informational categories with which many content analysis systems begin. 

Each diKumeni is divided into a number of paragraphs and a word frequency count 
of a selected group of words is recorded. A paragraph was selected as the informational 
quantum for analysis purposes because an idea or concept is usually contained within one 
or several paragraphs but not in anything less than a whole paragraph. Using these frequency 
data, intercorrelations among all words are obtained. These intercorrelations represent the 
degree of co-occurrence or association between words as they occur in the various paragraphs 
of the text materials. 

The matrix of intercorrelations is subjected to a principal components analysis to 
determine, in a systematic fashion, those components which can account for the inter- 
^ . correlation matrix in some meaningful way. By definition, the number of principal com- 
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i^^Hcnt^ \\\\\ \k \cn mAu\ icwci \\un \\k nun^boi of \n ihc \UiA Imnc Uo\\c\oi, \hc 

»no loLuoJ \o nuv.!*'nc^si/c. pio^unn lunnmj: innc and lacUn inUMpict.ibihiN H is ihc 
PUijv^NC *>t Uus pajHM lo dcNwnbc bou Uus ^an bo achieved, 

IkwripiitM) <rf ihe S\siem 

As in jnosi nauua) Saug\ugo studies, using a i.on)jnUci demands t\u\ ibe text 
:Mai.Mials must be jn j Miawhjne jeadable K>jn) Hns iKinslatjnn ot wnnen text into a 

hnu* loadable t*»rn is a \oi\ o\poitsi\e opcjatunK so thai an> savings ih.a be acbiev- 
x>! uisi be cxploued t*^ the U}\\ \n ouioi to .i\eKon)o uitnewcssaix expense .\nd t^^ meieaso 
. -u K \ i? u toiMu! viv^MKible ehnnM,ite a\\ mAHuA eodjne wheie p^^s^jbie. In ihis 
kIv U:e X vnplote text u.is tuit^vubed dne^ ll> oiu^^ puiubcd i^aids. wiiu h ,i?tej pjoo!- 
\\idn^i: Atu\ ^\Mu\Uni: >er\od t.ie law data input to the Just stajje ^^t the anahsis, 

liw' tijsi jraKtjvji \jop jn ihe anahsis uivohcs det?nnnunvM\ ^nd he^pjencies bM 
• X* \v*:'Me tc\i anvi tin n on a paiagiapb b\ paugiapli ba^i^i ( ottain \ la>>es ot woidsare 

A r "MiatK alK bcvause :be\ ^kvui ticquoniK oi ubKjujtnuslx ibat then 
nt! r.aii v -'•JUcnt is MnaJi ^ hose Woids aj! beionji to one the to]bA\nijl ^i^ups, eon- 
^ . ^ \^ ' and ^l:-/ vJeiniMO ajui nideluutc aUK^ies 

}hic to tbe innuaij^ns t^t the size a\aiLjb!e eoniputei men^M> and nia^lnne 
^peed ^euajn ^thet wojds iiavo \o be deleted Umn the other end i^l the hequeiKv spec- 
IbjN UMuH> means ibat all oi" the wmds ti^ai pjsi \kvut once ate deleted, Del tio,i 
uoids ihat neeuT once appears U) be reasi>nabk\ since we are particulaiK tnteresied in 
tlu^ u iati Misiups that exist between paia^iapiiN, and the.sc singleton wtuds can not eontrib- 
wh" an\ Thn)i! to ilie kntnviedge o1 nHor-p.^?a^iapb leiatit^nsinps. Succe^sne deletion of the 
UmnI tioquctuK iwcinnnj: w Olds is continued until a corpus ot words that will tit into the 
axailable coniputer ineiih^rv is obtained, 

Ihe soci>nd pass tiuougli the preprocessing program determines the frequency of 
thL selected words in each paragraph and this word frequency/paragrapli rnainx A^rnis the 
basis of ihe input \o the second stage of the anal>sis which is a principal componeiU;^ 
anais sis. 

hach principal component that is extracted consisb of a number of Wiuds that are 
most Inghly correlated and taken together dellno a Thcnuiik KicmcnL ^^'^^^^^ n 
principal Ciunponents are rotated to simple structure using a Varimax rotaijon in order to 
make the thematic elements more easily inierpreied. The i\\r^ step in this stage 4)f ilie 
anal> sis is to calculate the factiu sciucs for each o\ the paragraphs. The factor scores re- 
present the 'amount' of each thematic element in each paragraph. 

The matrix of factor satires is printed and sii>red on a disk file at the same time. 
The factor score matrix is llie input data for the final step in the analysis, a correlation 
analysis. A diagrammatic representation of the steps in the analysis are shown in Figure 1. 



TABLE 1 

Educalionil Psychology : A Cognitive View 



Thematic Elements 

Pen»onalny 

Factory 

InteHeci 

Motivaium 

VaiiaWo 

Suuaiion 

Social cla!»)> 



13. 



lnslructu>n 

Condition 

Variable 



80 
78 
78 
62 
51 
50 
49 
40 



83 
47 
41 



Concern 

School 

Academic 

Student 

IntcHcci 

Curriculum 



5. Commonsense 
Psychology 
Theory 
Principles 



78 
7? 
71 

66 
47 
40 



80 
77 
61 
49 



Learning theory 80 
Teaching theory 79 
Educ. Psychol. 50 



10. 



Verbal 
Concept 
Process 
Empirical 



82 
82 
S3 
51 



Meaningful learning 84 

Reception learning 81 

Task 79 

Rote 77 



6. Function 75 
Subject matter 39 
Discovery learning 39 
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Problems 
Applied 

Research 

Solution 

Relevance 

Science 



78 
76 

71 

57 

50 

48 



Pupils 

Teaching 

Motivation 



78 
69 
4! 



no 

FIGURE 1 
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Principal 
Components 
Analysis 



J 



Factor Scores 
of Thematic 
Elements 



4 



J 1 



1 r 



-t r 



Paragvaph 
Frequency 
Count 



J I i L 



T r 



JCross -correlation 
analysis. 
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h\ \Uc vjo>> cuticlation aiuiy^s. the iavU^ scores fui each thctnatic element, when 
pjoned on a paiagraph baM^. can be legardcd as a lime series, liach factor scoie trace 
cTi^s coj uMated wnh even other trace with lags of 0 and 1 

A lag 0 means that the traces are set side by side without any lateral shift in the 
paiagiaphN. In this case it the ^ortelation was high, then it would be interpreted that for 
mv^st of tljc text uiidci ciUtsidetatiiMt these two thematic elements are present together, 
Witli a lag of 1 . thoie is a latetal shift of one paragraph for the two thenvaiic ifkment traces, 
A high correlatii^n m this case, would be interpreted that one theme is followed by another 
thrxuighoui nuist of the text. 

Dutn^g die cross-ciurelation phase of the analysis all pairs of thematic element 
ttaces are cioNvcoiielaied wnh each other and the resuhs printed. Only correlations which 
are signtticant at tlie 0.05 significance level are considered for further imeipretation. 

\hc micipRMation phase has two pans. The fhst. the actual structure of the 
v.uttcn text Is plotted UMng the factor scores data and the information gained from tlie 
cit ss-conciation The decision as to whether a particular thematic element is present in a 
parat^aph depends on vs,hether its factoi score exceeds a critical threshold value or tiot. At 
this stage in the deveh^pnient of the technique we do run have any definite guidelines as to 
what is an appiopnate threslit>!d value . However, we have applied a cuti)ff value of + or - K 
and tins seems to woik reasonably well for the text that we have analyzed so far. Tlie cruss- 
conelation mdicaieswhKh ihematic elements - an be joined because of tlie significant 
coTTciation between them. The resulting diagram is a pictorial representation of the :exi 

The second part , can be regarded :is the idealized structure in that a plot is con- 
structed from those highly correlated thematic traces which could theoretically follow each 
i)t!ier. In this plot temptual sequence of paragraphs is implied. By tracing the various 
pathways tiuough this plot, one can trace the development of a series of concepts, 
t Figures 2.3). 

lllusitrative Examples 

The fust example is the first chapter of D.P. AusubeFs book Educational Psychol- 
ogy : A Cognitive View. Holt. Rinehart & Winston 1968, The chapter itself is called The 
rt)le and scope of educational psychclogy\ It was divided into 96 paragraphs, and the 
analysis carried out as described earher. Twenty four thematic eleirent^ were extracted 
accounting for 78.^'/ of the variance and of these 24, only 15 were hiteipreted. The cross- 
correlation analysis was carried only on these 15 thematic elemenis. 

The partial idealued structural pattern is shown in Figure 2. Only i partial ideal- 
lied structu e is presented here in order to avoid confvsion. What is presented, is enough 
to illustrate the technique. Figure 2(c) shows three sequential ihematic elements, where 
sequential is defined as the continued occurrence of the same thematic element. It would 
appear that in this type of writing, the same concept is being developed whhin itself and is 
not being mixlified by reference to any external theme. 



FIGURE 2 



— The Hiiponance of ilie acquisitioti of 

/ knowledge as an end in itself is giv^^n a 

f higher value. 

IntTapersona! factors within the learner 
(cognitive struct,; deveK readiness; intelL 
ability ; mot iv. & pers, vars.) 

13 Situational factors nt the learning situation. 



Comparision of the relationship between 
Ed, Psych. &Commonscnse, 



TheoriCo of learning vs. Theories of Teach- 
ing- 



Types of Learning: meaningful vs. rote 
reception vs discovery. 



Acquisition of concepts & propositions 
through inductive processing of verbal and 
nonverbal experiences. 



Extrapolated basic science research in the 
applied disciplines. 



Contrasting reception and discovery learn- 
ing. 



Relationdiip of teaching and learning. 
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n\ccn meamngtui learning and roio k\nnni^ and locqMh^n vcjsus disancix leanung !!u,s 
ihonic piogrcsMvcly modified by an\>iher thenianc ekMneni. ihcnie 10. whiLii diNCusse?^ 
the acvjuisUion \>l\*onccp!s and proposui4>ns ihri>ugh verbal and lunueibal expctKMwes. In 
.Muoi w^nds theuK* K) isbcMnc used to supph exaniplcN Um ihe deveK^pmeni \>f HuMnc 

Tiguie 2laMsby lai ihe niosi cou^plex set ot diemane nneMclationshipN. Voxw 
XhcuuXK clenient.N 3. ! . 5. a' J ^ aic all scquenual \n ehaiaetei hui wuh vety diUeicnt 
knids o! inicr-tolaiu>nshjp pauerns, For example, xhemc \ is benig pu>grc^snely nrodilied 
b\ ihemc in cxaeily ihc same way ihai ihenie 10 modified rhcmc 2 m l^guic 2<b). 
However, ihcmc 1 \n nun module.s ihenu^ 3 which tiom us inierpietation wnuid appoaj to 
bo at a higho! level ot abstracUxMJ. Ihenu^ 1.^ also niodifieN tiuMnes 5 and ?S and also scnes 
as a hnknig ihenie between i . and 5 atul ^- 

The second exanipic ist liaptei ^> of a geugtaphy book whuh diseusse^* the siukt- 
uie and undeiiv n)g coneepis of gov^guphy a.N a diNeiphnc. T))e boi>k by 1). Harvey in called 
l aws and Theories u\ Geographv*. !t ean be 5»een uom tiie ideahscd structuiai diagran^ 
H'lgure '^Mhdi the siructuie is a niueh nioio eoniplov imkv than vvc luive jnsi seen Joi 
AuNubek VwejO> four thematic olemeatN wcio cMiacted, not ail ot which could be iniei- 
piv JCd ineanuighiilv , The whole of ihc idvMhsed Mructure has not been piesented heie be- 
V.1USC «>i Us cinnplexuy . The partial diagiam tl i^uie ) that is shown liere, however, slunvs 
soveral nnptutant foaturc^s. For oxanipie. one can see on the far left side of the diagram how 
thematic element 5 acts as an hntiatoj . and is linked directly to live other thematic elcnKMiis. 
Thematic compvment 5 is aetualiy a discussion of the basic postulates for theory m gcogiaphy 
and so in that sense, it servos as an advance organizer. In contrast to thematic elejncnt 5. 
theme 4. on the nghi hand side of the diagram serves as a summary. The interpretatioii of 
the thematic component shows it to develop a general theory in geography which explores 
the links between sp;jtiai form and temporal processes. 

In this diagram too, one can trace the development of a particular set of ideas as 
shown by the pathway through themes 2. 7. 18. 4 and 1. (Table Zl Theme 2 is concerned 
with the derivation of laws in geography ; theme 7 discusses how gciigraphers use very 
specific examples to illustrate a point; i 8 would appear to be some padding and concerned 
with interaction: 4 explores the links between spatial form and temporal processes and 
finally theme 1 deals with how the ergodic hypothesis may be used to link temporal behav- 
iour with spatial form. 

An even better example of the progressive development of a set of concepts would 
be the pathway defined by the tliemes 20. 17, 16. 4, 1 (Table 2). Theme 20 describes how 
human geographers make use of the methods derived from social scientists in attetnpling to 
explain geographic phenomena. 

Theme 17 gives definitions of geography which give rise to a set of questions pur- 
sued in research in geography : 16 states that geographers must be aware of the empirical 
status of the laws derived from other disciplines: and we are back to them 4 again. 
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TABLE 2 

HA«V€Y THEMATIC COMPONENTS 

\ . Ihc cigoiltc h>poihcMb ma\ be .used \o link tcmpi^ial behaviour with spatiaJ form. 
MciliodologKai univetbaiin and the dcnvaiion of laws in geography, 

4. General Uieiuy hi geography explores tlic links between spatial form and lempora! 
procesb, 

5. The e>tahli>hnKMU of basic postulaics lor theory nt geography. 
7 (;eograplKM> irequenily use statements of low order generality, 

8. Physical geograpliy applies laws derived from physics, 

9, The concept region in geography may perform the same function as that of class 
in science- 

1 1 , Geometry provides ifie language used in discussing the sets of relationships inherent 
in problems of geographical interest. 

12, U has been argued that universal laws have no relevance to cultural geography because 
of the dif ferences in the value systems of different cultures, 

13, The literature of the subject provides a wealth of source material from which to 
derive an understanding of the nature of geography. 

15. There are problems of formulating laws in geography as is apparent in the studies of 
several research workers, 

16. Geographers must be aware of the empirical status of the laws derived from other 
disciplines. 

17. Definitions of geography give rise to a set of questions pursued in research in 
geography. 

18. Pri^bably discard. Very generally concerned with interaction, 

2 1 . Some concepts used by geographers are derived from other disciplines, 

:2. Some concepts arc indigenous to geography (and may be used in the development of 
ihco v m geography ). 

O 
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Area!i of posMble appiicatioii 

Five main areas of application ot this technique spring leadily to mmtl and ihey 

ate in. 

\ 1 } hifonnation storage and retrieval 

{2, Oeveiopmeni of readnig tests of t,K ^ lo£e type, 

(3 \ Analysis of dialogue 

(4 ) Textbook evaluation 

(5 ) Curriculum development 

If the idealised structural network w as developed using w<iids from abstracts of a 
selection of research papers and books then the netwiuk diagram itself Wi>uld represent a 
developmental history^ of that particular subject area. The various patliways throu^i the 
network w\nald show how a particular idea was developed and how it wai^ related to other 
ideas. For example, if one was working in the field of Early Childhood Education, there is 
a considerable bi>dy of research literature concerned with human intellectual development 
and it is possible to trace the development of curretu practice thnnigh a sequence of relat- 
ed research d\>cunients. There is ;dst\ ^ body of related knowledge which deals with the 
iclaiionship between nutrition and inu licctual development. Where these two pathways 
intersect in the network diagram one would expect to find a selection of documents deal 
ing with aspects of nutrition and its effect on intellectual development in ECE, There is 
really nothing new in this idea because in fact, tliis is precisely how the present library card 
catalogue system works. However, one can imagine with the idea or concept linked cata- 
logue, a user of the library would be supplied with a map of his particular area of interest 
instead of having to rely on the card catalogue. 

Secondly, in the development of Cloze type reading tests where certain words are 
systematically deleted and must then be replaced by tne person taking the test, deletion is 
carried out !systematically, say every eiglith word. The use of text structural analysis would 
allow systematic deletion of words occurring in only one thematic component. 

Thirdly, in the analysis of dialogue such as may take place between a teacher and 
a student. It would seem that the skill of a good teacher lies in his ability to match his level 
discourse to the conceptual map of the student. By continuously monitoring and analys^ 
mg the feedback that he receives from his students, tiie teacher will be able to judge whether 
the material he is tiying to teach is beyond their grasp at that point in time or not. Analyses 
of this kind could be used in teacher training programs to analyse discourse in microteaching 
sessions. 

Fourthly, the analysis of textbooks. So often the adoption of a textbook or the 
lecommendation ol a particular textbook is an idiosyncratic decision. Maybe it is ihe lay- 
out o{ the pages or the particular type font that appeals to the teacher i^r lecturer that 
leads \o his recommending the book fox use in a particular course. How much bet .cr it 
would be to have some objective mean^ of evaluation, so that the teacher can be sure that 
aW oi the elated 4>b]ectives of the book liave been met. A thematic and structural ;.nalysis 
ot such a textbook would allow such an objective evaluation. In fact a doctoral dissertation 



IN being completed hcjc m the I unctsuy Oueomlaiid. ai the moment iti tins very area, 
wheic tviogoo^iaph\ io\tbAn>k\.ind seveial fcsoaich papers arc being analysed m this way 
in oidci to see U the\ have been written ucondrng to the accepted structure of the dis- 
cipline and also to see ii the> arc cunMstcnt with any learning theory in educational 
ps>cholog\ . 

iMnaHy. theie is the area of cuiikulum deveJopntem which is really an extension 
ot the textbuuk analvMs except that u would be an ongoing adaptive procedure in that the 
analysis would be earned out continuously dunng the development of the curriculum 
niatetials. It would not njoan that there would be no more field trials or a need for eval- 
uation, but lather it would speed up the whole pri>cess of producing a linal version of the 
nia:eruLs. So much tune, money and energy is presently wasted in trying to evaluate new 
curncuhnn maienals, when it is an almost impossible task due to the interference effects of 
the niatenals, tlie classroiMU environment, the teacfier's characteristics and the student's 
own motivathnia! and personaHty variables. 

The second half of this presentation is a description of just such an experiment in 
curriculum evaluation where one small pan of one of the ASEP units has been rewritten 
and then taught m one uf the Brisbane metropolitan High Schools, <See Clarke's article 
which toilow!*,) 
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THE ROLE OF THE CONTENT AND STRUCTURE OF 
CURRICULUM MATERIAL IN COGNITION 

John A. Ciarke 

Introduction 

In TCceiU >caTs. numoious wriiors have tiighlighted the need for various types of 
5itudie5i of ASEP materials; in particular evaluative studies designed to determine whether 
the picture of science presented in the materials is valid, iMoritz, 1972; Power, 1970). 
Wliat is reported here is an evaluation of the core of an ASEP unit **Pushes and Pulls'' 
fASEP; 1972a) v^nhout the possible distorting intluence of teachers, pupils and school 
environment, a revision of the core on the basis of t!ie eviduation^ and a field trial of the 
original and revised versions. 

Curriculum evaluation 

A conventii)nal approach to curriculum development is shown diagrammatically 
ui Figure K where "formative" evaluation (Scriven; 1967) takes place during development 
and by the use of field trials. 

Available teachable 
cultural content 

Field Trials ^ Final Product 

Field Trial 
formative 
evaluation 

2^ 

FIGURE 1 

Pre-trial formative evaluation is built into most curriculum development schemes 
in the forn-t of ev;duation committees, (ASEP, 1971 ; Ramsay, 1971), referral to**experts ' 
(Grobman, 1969; Lockhard, 1968; Welch and Walberg, 1968), etc. Questions have been 
asked about the objectivity of such procedures (e.g. Herron, 1966). However, most form- 
ative evaluation seems to come from within the classroom, (Lockhard: 1968) and perhaps 
more important are questions such as, how useful is the field-tri^ formative evaluation 
feedback, and how much is this information a true indication that the unit's objectives have 
been achieved? It is almt^sl impossible to determine the amount of influence that teacher, 
pupil and environmental factors may have in enhancing or inhibiting the objectives of the 
curriculum developers. It may be suggested that what really matters is how the curriculum 
"works" in the field. The problem still remains however of differentiating between out- 
comes due to the material and outcomes due to factors other than the curriculum and know- 
ing how much pt>ssible output has been lost due to, or distorted by, 'interference'. 

Q Curriculum theorists Johnson (1967)and Macdonald (1965) recognize this problem 
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of Objectives 



Development 

Pre-trial 
formative 
evaluation 



Feedback 
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when they note ihai cuHkultnn evaluation ib all hH> o\\\:n \.ond\Kied at tiio oiupm 
mstruciion raiher than at the uiput positjun. with ihc result thai 

auiuulum evaluation i^con^ounded wuh msiiuctionai evaUiauon. 

CuuK'uhui) serves* aj* a cntenon tor insttuvtional evaluaiti^iu vana^^\n)^ 
in imtrucuoii cannot be peniuueU to entoi into the evaluation of 
eurricuhnn" (Johmon; h)67;135)- 

Some suggestions have been made as to luw to Dverci^nie tlie *inteilerenee' prob^ 
leni, Johnson, for example, suggests that differences in instructunial e f fee ti veneris 
must be controlled, randomized, or pariialled out \ Ubid) These methods may be diltic lit 
and perhaps tvot completely successf ul. The only sure way wiuiid seem to bo to evaluate 
before any field trials. 

This pre-trial formative evaluation, should, in part. alK^' an evaluation of the 
poienfiai of the material to allow pupils to achieve stated objectives, allowing a re^^tiuctur- 
ing of the content, if necessary, to more civsely approximate stated objectives before 
mterfering field-trial influences distort the outcomes, and hence allowing more reliability to 
be placed on the outcomes i>f field trials. 

In an attempt to do this, what is being suggested is. in addirion to the perhaps too 
subjective (?) pre-trial formative evaluation strategies presently being used, and in keeping 
with the idea that it is necessary to include elements ^'from the outside" in formative evah 
uatiim (Ahmann, 1%7:87), that there be a more oibM /iv^ evaluation of the final pre-trial 
product by means of an analysis of its content. 

Content Analysis 

Content analysis, defined broadly as 

a multipurpose research method developed specifically for in- 
vestigating a broad spectrum of problems in which the content of 
communication serves as a basis of inference" {Holsti, 1968:597). 

or more specifically as 

" a research technique for the objective, systematic and 

quantitative description of the manifest content of communication" 
(Berlson. 1952:18). 

has been used to investigate a diversity of problems. 

A recent comprehensive review of content analysis research is given by Holsti 
i 196^), Most of these studies, however, use cither a sophisticated analysis specifically de- 
signed for a given purpose <e.g. Tlie General Enquirer; see Stone cl ai 1966), or very simple 
frequency counts, both of w hich have limitations Further, there seems to be little study 
m the education area, or more specifically in the science education area, most research 
seeming to concentrate on history, politics, etc. 



Ihc oxvcpuon \h\s uu\ he KMddbiht> ^oscatch wheie auribiucs of content ar€ 
couclaicd wuh ca>e ot coni}MchcnMon t haiactOTiMks ot text which have oJien been tcsv 
cd HKkide \aiunis aspects vocabu!ai> <divef Miy, hurd wordx km^ words, abstract words), 
seiuenco stiucuie t length, t\ pc iuuiiber prepo.sitional phrases or mdeiermmaie clauses) 
and human nuetcsi clonwnistpctsonal pronouns, colourtid wordsl <Holsii, 1969), 
ttaidnei t using ptoccduics based on earlier wiuk by Hesch (1948) evaluated the 

leadabilns oi ihe P.S,SX\ te\i Un Austiahan students. AStPalso used the Flesch read- 
abihn lonnulas to prepare ihen n^atenals The ASliP Harrdbook;46 50), and have devel- 
oped a checklist lor analy^ng the ^^siyle** ol their nraterials (Shepherd, 1972). Although 
nreasuies ot siyle and readabiUty are obviously essential, the lormulae etc. can only check 
on the conrprehensibtHt> ol the text. They can, in no way. check that the content itself is 
\ahd. The approach here is \o use a technique reported in an earlier paper (Carss: 1973) 
on the core ^ Pushes and Pulls ^ t ASEP; 1972a). 

ta) to isolate the important themes ot the content, 
tb ) to detect structure, if any, and 

tc) tt> see It the themes and the structure have the potential 
ti> aclueve the stated objectives. 

Once x\m has been done, useful objective pie-trial formative evaluation feedback 
will b** available as a guide toi any rewntmg that is necessary. 

The ori^nal curriculum {C^) 

1 , Thematfc Elements 

The Principal Component analysis isolated thirteen significant components which 
accounted for 55,1% of the variance. In order to name these thematic elements effectively, 
it was necessary, tKcasionally, to look at the text to see in what context the words occurr- 
ed A summary of the themes appears in Table 1 . 

Theme 1 is obviously a measuring ' theme, combining both how to measure 
^stretch, mark) and what to use (rubber-band, metre-rule). The hi^ loading of "centimetre" 
suggests a quantitative as well as a qualitative method of measuring. Theme 2 outlines the 
structure of the total unit, including the core and options plus some idea of how to record 
answers to small self-evaluation tests that occur throughout the unit. In Theme 3, apparat- 
us Uubber ball on table) is being used to pose questions about forces. 

Themes 4. 5 and 6 appear to be themes that one would expect to be related if any 
structure exists. They describe a way of "seeing" forces act (6), and what they do when 
they act (5 ). logically leading to an operational definition of detecting and measuring (4). 
Whether these themes are. in fact, structurally related will emerge later- 
Themes 7 and « are "comparison" clusters. Theme 7 seems to suggest a ••sensi- 
tivity* theme small and large lorce -measurers being calibrated against a standard. This 
theme may be weakened by the lack of some quantitative words e.g. tenth, unit. Theme 8 
IS an example of a theine wliere text consultation was required be! ore a suitable name could 
Q beapphed. It is suggesting, m fact, a preparation for calibr on using wasliers that have the 
E RJ[0^"^^ different weights. 



TABLE 1 





TH€MATIC €t€MEIMT 




WOnOS IN THEMATIC ELEMEMT tLOADIAJGS) 




liHt^nluclory remarks on 
the phenoinena ol 
incasurcnicnt 




centinuMic 
Ntreich t*>0) 
iubhei band t >tS5 } 
graph < C)3) 


mark (n>.t .'^^) 
Wtic luic ( 5 J) 
length {A2) 
pull (uM 41) 




Omline of the unit 


5 J 


option 
icst ((nM.o4) 
conM-801 
book < -70) 


record book (.7 )) 
answvM (u)(>!>v) 
each ( 4^) 
before (,42) 


3 


Pi>NUig Qucsnons 




rUDDvr*uajl t A'.^ i 
happcMH 87) 
suppose |,87) 


lanK ( >o.i 1 
que^uoij (,73) 


4 


IXMinnuni in t>perational 
lornis 


4Jb 


defininon (.83) 

ikMtVt 1 

hxm{J2) 
telM-65) 


uy ( 5(>) 
nicaMuo (,55) 
only (,52) 


5 


Cv>n)parative cflVvis of 
ciiance ofstatc 


4.5 


cliangc <v)|-,85) 
shape <n)<--85) 
act (-,7b) 


mujh (-.5b) 
know (-.52) 
hucc<n)(--45) 


b 


Concept of a f orce 


4J 


push <n) 1.81) 
puU (n) ',80) 
see (,7 1 ) 
way (.53) 


length (.51) 
word (.4o) 
something (.41) 


7 


Sensitivity oi measuring 
instruments 


4.2 


large (-.79) 
newton (-.76) 
small (-.60) 


force-measurer (-»46) 
weigiu i-*4j j 
blade (-.40) 


8 


Preparation for calibration 


3.9 


different (.77) 
weight (.58) 
same (.54) 


many (.47) 
result (.46) 
each (.46) 
washer (,41) 




Assembling apparatus and 
developing standard scale 


37 


card (,60) 
mark (V) (.59) 
up (.57) 
zero (.53) 


force-measurer (,47 ) 
now (42) 
your (.40) 
blade (.40) 


10 


Mode) of a scientist and 

Hie m^tTi/^rijr^lf\0\/ 
Ills illClilV'Ul'im^j 


3.5 


scientist (-.88) 
like (-.79) 
word (-.58) 


find (- 45) 
give (-.42) 


H 


Instructions on perfonming 
experiments, recording 
and examining data 


3.4 


add (-.78) 
sinker (- .63) 
do (-,43) 


i: 


Instructions on 
calibrating 


3J 


stop (V) (.79) 
mark (n)(.66) 
washer (.58) 


blade ( 56) 
unit (-47) 


13 


Procedural instructions 
and nummary 


33 


check (-.65) 
page (-.62: 
sure (-.56) 


answer (n)(-.51) 
before (-.46) 
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BEST CC?^ AVAlUBli 1:3 



Uimcmum iin.uK. /cio|, I ogicailv . 11 would link uiih 01 uin conaUHMU with, Tlicmos 1 1 
and 1 which * in TUKiioi.ar^ ihcmcs. one giving insirncuon^s on measuring ihe 
oihc^ m>tnKnonN cahhtainii! Again an> structutal rolanons will be seen later 

1 heme 10 scems to be tryntg to say "Scientists do things like this'' or -'We are go- 
ing to do UungN ihc wa\ scieniists. do'\ Theme 13 is obviously one ot msiruciions con> 
vcnung the Nelt evaluation that occuin tituuighout the unit. It is much tnore specific than 
Theme 2 which relates to the whole unit, but one would expect perhaps some structural 
relationship with Theme 2 and .uher quantitative themes ie,g» ^, 1 2 ^) 



1. StruCiiJire 

The I'losb coirelation anal\si:> makes it possible to see ai which stage themes 
cmetge and recede, and also which themes and Mibthen^^s are linked. The results oj this 
.uhilvMs .110 sh.n\n dMirtainnumcally m Figure 2. It can be seen Itimi Figure 2 that there 
aic um disunc! pans 10 ihc unit. Pan 1 tpara. 105 1 appears to he the most mtegrated of 
all the paits and omtains three major themes, 4, 5, and 6. h begins with a two-part 
int!4uUiv tion .-Jgin pjjagraphs. Instructions, and the predicted linking of Themes 2 and 
13, occm \u the Inst pail while some hint iif things to come occupys the second part vi?„ 
:hai pupils \\\]\ he "seeing" umccs 1 1 heme obsejvuig iheu eftects tTlieme 5 I moasur- 
uig tTh«Mnes S), cvaiuatmg 1 1 heme 13) and detimng tTheme 4) these effects ''just like 
scicnusis'^ < Theme 10), This latter section acis as an '^advance organizer** for the whole 
c^ce. Then follows a six paragraph block (8-13) in which forces are actually *'sccn" i,e, 
the Ciuicept of a loicc t Theme b , 's developed, hiiportant sub-themes here are Themes i 
and 12 wheie the idea of measuring forces is introduced. Wliat a force is, leads logically to 
wliat a fmcc Jih^s and this theme iTheme 5)diTOinates the next major paragraph block 
tU-lS). Ouesnons are asked abi^ut what a force does (Theme H and links ;ire made with 
what a force is <Theme 6) and a range of measuring and ev;duating themes. The section 
culminates in paragraph 18, where some self-evaluation (Theme 13) concerning forces 
(Theme 6) occurs. Paragraphs 18 20 form a bndge beiween what forces do and the next 
majiu theme, I heme 4, w hich i:. concerned with developing a meihixl of defining force in 
operational terms \u. detecting and measuring. Hxperimental activity is again present to 
sume degree (Themes 11.12,13). Part 1 finishes in paragraphs 24-25 with a summary and 
self-evuluatiim (Theme 13) *1ike scientists do" (Theme 10). 
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The suggestum that Themes 4, 5, and 6 should li>gically have st>mc structural re- 
latii>nship have in fact iKCurred. At the end of Pari 1 there is a definite hiatus suggesting 
perhaps that a new sequence of events is about to occur 

This new sequence doe^J, in fact, eventuate in Part 2 where, generally speaking* 
there is change from measuring and detecting to calibrating. One would expect, with this 
more quaniitaiive approach, a need for greater precision and this is reflected by a strength- 
ening of the evaluation strand (Theme 13 ), and more instructions on ^experimenting 
assembling apparatus (Theme 9), preparing hu ana calibrating (Themes 8, 1 2) and record- 
ing and examining daiL (Theme 1 1 ). &)me o\ the earlier domirani (hemes have all but 
disappeared flie * detection ' (Them 4) and ''examples'' (Theme 6) job being virtually 
tmished. They have laid ihe foundaiums for ttie more ditllculi calibrating themes that 
diiinmate this secinm. 
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Pa!i : also lu^ a uvo pau iiii:xK!iK imn but of six paragraphs only, <26^31 The 
litNt una ihe stajic'* loj tl)o uholc o\ Pan : when ijuosUons are pos^d <T!uniK 3)and 
ihcic JN piepaumon tot expcfuncniation O hemes K 1 1). The remaining two paragraphs 
tennnd pupiK about hov\ hi use ihon rccoid boi^klcis ioi this new quantilaiive experiment- 
atjnn HiKMne « i \n pauj^iaphN ^^l-.'^S. the eVkvts of h>ices tTheme 5 )arc in laci measured 
quant^taiuoiv tlbemcN 1. 1 1 )and M>nK^ hmi oi cahbiatioo occur>» < Themes 12. 13). Vhe 
icnumdcj ot Pan : t3o 45 1 1> devoted vompietciN \o this caUbialion, The piedietcd 
NtuK tural lelatumslrp ! homes \ Z and 13 developed a^ all three strattds strengthen, 
muil with the assistance ot li^ome s ipara. 42) the hnkages occiu near the end ol Pari 2 
t4.^4N I Iheme 13 also acts av a nutans of sumnKni/tng and givjng luriher instruetiotts. 

Pail IS ain5>^si dexotd ot" stiucnue apan turn an eaily attempt to prepare tor 
lunho! scKMintk o\peu!nem.uii>n Uhemes N/^, H)V ll the anaK sjms vahd, one could 
sugi^est that Ukmc seems lobe hale ol consequence occunmgas tar as the development of 
the vtMuepi oj -..v^n^cmed. An cxannnaiion oi the content (AStP: 1^72a: 20-22) 
shows thai 1? ^^ .UMhiiii with ^'liot^d Standards u^\ Measutement^^ and is attempting to 
develop ihx: ..Mu.-pi .^ ^^a!ldaK^. leadu^g evemaulK to ihe newton. The only possibly dis- 
tuibntg feafuic ihc laiUirc of Uus \standa!ds^ iheme tPossibly Tiieme 7'^) to emerge is 
that a is leqmt od ioi the ne\i ^cciumk Pan 4, Pan 4 t5^)-7<))doeb not seem ivi be as highly 
mie^iaied a> 1 aikl ^ apaii injin a suucunaiK compicx miroductio;i i<30'^:>4^ The 
i^eneial lhenK^^ aJO n^os.^ ot ^jlibratu^g and cxahiaun^^i tl hemes o^ 12. K^jbtU mcludmg 
a>ueU Theme on ulnch "newuMr" loads hidilv r7<> ) >uggestmg compuribon w\th a 
standard. 

Tlie intioductioti ia>s the bas.s for ihis standaTdi/aiitMi but the auempt dtxis not 
seem to succeed, tpjobabk due lo the lack supp^nt from Part 3) as evidenced by the 
middle section to> 75 ) winch is rather disjomted. Tlie tust pan <65^70) attempts to carry 
out ihe siandardi/aiion. \vhile the seCiMid pan t7 1-7^ ) attempts to extend the new ideas 
■ suppose Vxui wanted i«i nieasuie something heavier than one newton" { ASEP; 1972a:27), 
The remainder ot pan 4 t77-7<))contains a cure self-evaluation test and instructions on how 
w prvvecd onto the options (Themes 2. 13 ) There seems to be no evidence of any attempt 
1x1 Numman/c tlie \vlu>le coje. 

Tlie '^ideaf or ^Vssence" o\ the structure can be achieved as indicated in an earl- 
ier paper tCarss, ]073 ). The 'Vs>ential siructure^^ is shown in Figure 2 A which shows that 
the themes divide themselves into two interlinked chains quaUlative and quantilaiive, 
Tlie mam aspects iO structure that emerge are that 

U) Themes 5.6, 9 and 1 1 are tiie important "pivotaP' elemenls or 
*\u*>wing points'' of the structure: 

(b) Themes 1 . 3 and 1 2 are terminal themes; 

<c) The concepts present in the structure can be obtained by 
tracing the numerous pathways e.g. 2-13-4-5-6-10; 
q,134-5 ^-l etc. 




FIGURE 2A 
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} Rel3twnshm of ThemaHc Eienients ^nd Stnwture w Stated Objectives 

To doictnime how well the Ci^e has the poiefHial lo achieve the expected out- 
cuincN. a vomp^^J^5»on can be made between the conieiu and logic unphed in the thematic 
ckMncins and then sluK tuio. and the statement of expected knowledge outcomes. 



Expected Knowledge Outcomes iKO) of the Core < ASEP; 1^72b vi) 

1 The tirst actnmes aie designed to allow the students to visualize unseen forces 
by ohseiving .ncir eftects. The students are shown that forces cause observable 
reactions F\Mces cause i)b3eci> to; 

1 , 1 Change shape. 1 3 Slow down or speed up. 

1 Start or stop moving. 1 .4 Change direction. 

lv,0,2 A :,cionnst gives a description (or detlnition) of a thing by answering two 
questions, 

M How can 1 tell if 1 have some of this? 
HiAv can ! tell h<w nuich of it 1 have'^ 

K.OJ You can tell how much force you have by the amount that it changes the shape 
of Mmiething. 

K 0,4 It is necessary to have a caHbrated scale to measure something. 
K,0,5 It is important to have standards of measurement. 

K O.b Wlien forces cause certan objects to cha ige shape these objects do not return 
to then orij^nal shape. This characteristic makes them less useful than others 
as force measurers. 

K.0.7 Weight is one kind of force. 

K.0.8 An instrument must be zeroed before making a measurement- 

K.0.9 The newton is the standard unit of lorce. 

K.OTO An instrument can be calibrated against a standard instrument. 

K,0. 1 1 The range of an instrument can be extended by chaning its sensitivity. 

K.0.12 A force measurer can be used to measure forces other than weight. 



KC 13 Knowledge that a standard must be plentiful, of suitable size, easily duplicated, 
agreed on by eveiy <'ne. 
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EXPeCT£0 KNOWLEDGE OUTCOMES 
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A .onnxuison oi Uicnutic cWnicntb and knowledge outcomes is shown in Table 2, 
and suugestN WvM ihe majority oi expected outcomes arc lepresented to varying degrees. 
However, some euhet do not occur <KA).LMor arc only weakly rt^presemed {K.O's 5, 6, 7, 
it), 1 \ ) 0\ the Liuoi , K (Ts 7 seem highly specific in that they would probably need 
to o.vut once Ihe icmamdc!, along wtth K.OJ;^ tonn a ^^tandards'^ cluster, Ex^ 
ammaiion ot the content show that the development of the concept ot the standard ncwton 
and cahbtainm ot msttuments ot vaiymg rariges against ihts standard is the responsibility of 
WuU 3 and 4 o! tl^e ane. h !s m these areas that the material is most poorly structured- 

The ht\>ad ami ot this ASHP unu is 

. to allow the st\^dent^, through his own investigations, to arrive 
at .ill undeiNtanding of concept ot a toice. hi the process, the student 
builds a t\nce-measurer and calibrates a scale in newton units . . , . In 
adduum. the student activities ate designed to develop a scientific 
appoMch to pioblem si^lving, ihe gathering of data for interpretation 
ai:d the presentation oi daia.'^ tAStP: 1^72b:ii) 

and the anahsiN suggests that ilie ciniteni has the potential to do tins up to a point. The 
analysis also siiows tliai the content seeiUN to be aimed at the correct cognitive readiness 
level of students, AusubeL Wi>rkmg witlun a Piagetran framework suggests that 

. ii would appear that, tin the Ci>ncrete i>perational stage), given 
onl> the siimuius support provided by concrete images of examplars 
o! criteria) images, the child would be able njentally to construct a 
lepiesentativc image embt^dying the meaning ot the concept." 
tAusubel and Robinson, !%^:185), 

and tlie high emphasis on "doing'' and "seeing" wi>uld help to achieve this. 

Qui^^tions that the curriculum deveh>pers may ni>w ask, however, are: 

{\) Do themes emerge and fade at appropriate times? The non-emergence of a 
-standards^' tlienie at the appropriate time <i.e. paragraphs 48-58) may be a cause for con- 
cern. 

{ii) Is tiiere any "dead wood" Oi poorly structured material present that may be 
interfering with the develi>pnv.Mit of a theme or the concept as a whole e.g. in paragraphs 
48-58,65-75-.^ 

(hi) Is there any need to "tighten up'^ the sirueiure of the latter sections which 
are not as well integrated as tlie early sections. 

The inadequacies of the core hi^lightcd by tliis analysis of the content, may be 
overcome by a revisii>n ol Parts 3 and 4, 
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The revised Curriculum H^^) 

1 , Thcoreticsi Basis of the ^ev/s/on 

Bnuun U^Jt^<^ l^^l in discusiMUg curricula coniUuctiun. regards \>ne i^f ihc mjj.n 
pri^blcnis as being 

how to have basic subjectJi icwnttcir and their teaching niaicrials 

revamped in such a v^^uy that the pervading and powerful ideals and 
attitudes relating to them are given a central role," 

SiMue learning theorists have delved deeply into this idea that the srrm rure of ihc 
material presented to learners is of the uinu>sj nnportance. ihe be^i known jvihaps beuig 
Ausubel whi^ says, for example, that 

, . llie major impHeativm for teaching is that control over tiie aceuraey, 
clarity, longevity in memory and transferability of a given body of 
knowledge can be mosi effeeiively exercised by attempting to innuence 
the cniLjal variables tif Ci^gmtne suuciure , , , , e.g. by emph^ying suitable 
pTogrannnatK* prmcjples o\ tndermg the subject matter and constructuig 
lib miernal logic and organi/atum/' ( 1%4: 168 ) 

His ideas of ^'advance vnganizers" etc. are well documented < Ausubel; 1960, 196?) 
ai.d ha^.e been used successfully in science education research (see for example, reviews by 
KuluK ( ) and Novak a d ( 1^)7 1 ). 

Bruner n964:3(») suggests that the structure of any domain of knowledge may 
be characterized in three ways, each effecting the ability of any learner to master it, the 
mode of presentatiiMi. its economy and its effective power. Figure 2 and the subsequent 
discussK^n suggest thai some of these conditions particularly ihe last two may not be 
present is much as they could he. NVIrat seems to be required is some restnk uring and 
rewriting of Parts 3 and 4 (t>r slightly before), with emphasis being given to economy (no 
"dead wuod" ) and ettectiveness (potential to achieve objectives) without loss of appropriate 
level t>l dil iiculty. readability, visual impact etc. (mode of presentation). The Ausubelian 
ideas o\ 'advance orgaui/ers'\ "integrative reconciliation'" etc. may act as theoretical guides 
\<n the lew niing This new version can then be reanalysed by content analysis to see if the 
rewriting has been successful in overcoming the apparent deficits of the original content. 



2. The Revised Curriculum 

Paragraphs 46 to 79 were rewritten and reduced by three paragraphs. Tlie source 
oJ ♦he original ASEP material proved to be most useful here i,e. 'Trobing the Natural 
Wnrld. Voi r' (jSCS:l*^70). This reduction occurred in Part 3 where most of the '*dead 
wood'' seemed ti> be. An example of the rewritten material is as follows: 



BEST (X)PY AVIULABLI 



Of^tGINAL CURRICULUM iC^^) 

^^Pubhcb and FuUs'^ {i^ll.^ 20) 

By now \ou Knov, thai youi '^washvMs^' 
card In dt!icrcn! Jiom \hc cards i^l some 
ut voiu ncMghbtuus. Yxhi may have 
cvcn^uesNCd \\h>, Alihough ihcy looked 
the same the piles o! washers in cacli 
pile weighed the same hui th^ise m 
diHeiciit piles had dilterent weightN, 
You can check this bv Meohng the 
weighi o! a pile t»t each colour. 
Thisis wh\ >ou and nianv o1 yi^ur 
clasMiiaiesgoj ditfeieni results wiien 
you weighed iho sinker. 



REVISED CURRICULUM %C^) 



47R 

By now you know thai your ''washers" card 
IS diifereni from the cards of some of your 
neighbours. You may even have guessed 
why. Go back and think about how you 
made the scales on your '^washers'* eard,^ 
Yiiu made a mark each lime a washer was 
added tt) the cup. Anything < such as a 
washer) that is used to make a scale is 
called a swudaru,^ 



4H 

The scales made with ditVerent washers 
will not be the same. The\ differ 
because menil ms \>t \our class used 
different standards'^ inake ilieir 
scales If everyone had i;sed wasJieis 
that weighed *ho same, the maiks on 
all cards would have been m the same 
place <the scales would be the same). 



4NR 

Now compare viuir scale with the scale o( 
your classmates. If the "washer units ^ on 
yoUT scale are not xhc same, it Mieans you 
must have used different standards to make 
them. Thus, the washers of different 
colours must liave different weiglits. You 
can check this by 'feeling the weight' of a 
pile of each colour. This is why you and 
many 4if your classmates got different 
results when you weighed the sinker. 
0 23. How would all members of your 
class be able to produce the same scales?^ 



1 , Integrative recoiicihation ( Ausubel; 1963:80-1). 

2, In C , this is the iirst mention of the word • standard". There would seem to be a 
need*^to introduce this earlier to avoid confusion between ^'standard" and **scale". 
This is di)ne in by means o( a definition an '"expository organi^eT'^ 
(Ausubel. 1%0). 

3, To pii>mote pri^bleni si)lving and test understanding of the section. 

The new core (paragraphs 1 45 i»f the original core and the revised paragraphs 46-76), 
was then analysed as before. The resultant thematic elements are shown in Table 3 and 
the stujcture of paragraphs 46-76 is shown in Figure 3. 
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TABLE 3 
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THEMATIC ELEMENT 




WORDS IN THEMATIC ELEMENT {LOADINGS) 


! 


Introduciory remarks \>n 
till, piiciionit. 1)1 




ceiuinKMic (.^2) 
sireuh {S)l) 
TuhhLM-haiid 1 SI > 
graph tb^) 
show <vH .<34) 


amount ( 51) 
metre-rule ( 4*)) 
mark iwW A^^\ 
pull (n) (.42) 
need ( .40) 




Oiuliiie of the unii 




option \->^2) 

V*'*^ 1 »V'«-» J 

test (nX-,80) 
book (-.71) 


fecord-bo\>k (-.66) 
each (-,50) 




Posing quostions 




rubhei'h ill i ^4 i 
suppose (.^>n 
happen <.iSt?) 


table i 8 ^ > 
question 


4 


terms 


3.7 


detiniiion ( .81 ) 
how (.67) 

HI. ICV i 1 1 

telU.o:) 


measure (.51) 
tA (.50) 
4 ink 1 4 ^ i 


5 


change ot siaie 




shape (.76) 
act (-75) 
cliange (.74) 


much ( ,66 ) 
know (.5^>) 
lorce (n)(.S:) 




Concept lit' a lorce 


4.: 


see ( .73) 
push (n) (.70) 
pull (n)(,68) 

find (.53) 


measure (v)(,49) 
something (.49) 
length (.44) 
word ( 4^ ^ 


i 


Sensitivity i^t iiieusuring 
instruments 


A Q 


tenih(.86) 
w^iflh ( 76^ 
newvjn (.71) 
weight (.68) 
small (.60) 


unit (.57) 
sinker i 5 1 ) 
do (.43) 
try (,41) 


8 


Preparation io\ calibraiii^n 


3.: 


collect (-.73) 
large (-.7 1) 
sure (-,62) 


before (-.57) 
blade ^.41) 




Assembling apparatus and 
developing a standard scale 


3.7 


zero (.J5) 
force-measurer (-.56) 
card (-.54) 


mark (-.52) 
paper-hook (-.45) 
now (-,41 ) 


10 


Model of a scientist and 
his methodology 


3.2 


scientist (.82) 
like (.77) 
word (.59) 


many (.48) 
give (.47) 


11 


Instruction on performing 
experiments, recording and 
examining data 


3.5 


time (-.66) 
add (-.62) 
each (-.60) 


amount (-.53) 
same (-.48) 
sinker (-.41) 


i: 


Instructions on 
calibrating 


3.1 


stop (-.77) 
mark (n)(-.65) 
washer (^.53) 


move (-.41 ) 
blade (-.41) 


13 


PrtKcdural instructions 
and summary 


3.7 


different (.78) 
check (v)(,76) 
page (.71) 


answer (n) (.60) 
answer (v) (.52) 


14 


Ciraracteristics of a good 
standard 


4.2 


standard (.84) 
measurement (.82) 
good ( .76) . 
object (n)(.48) 


make ( 47 ) 
choose (.46) 
all (.43) 



,v Thematic E'ements 

nught he cxpcvtt«d, ihctc was a rcdistnbutioij oi variaiKC and changes in the 
lo idintis o! vso.ds bui the Older ot ihe orignva! JbcmaUc cJcmcnis has been maimamcd in 
1 able ^ to allow easx oMnpativMK As nnghi also be expected, there was a large degree ol 
conespondence hetwoeti the twv. sotb ot thentes. There were however, tour stginhcant 
eltattgcs I nstlv . aird po,hap> must unporianily. a votnpletcly new ihematic element emetg 
ed (Theme I4j vt/ cha.actcttstu> o\ a good standard. Tins thente should have emerged m 
Pan 3 ot the onutJtal eurncuhnn. It should appear in this regton nt the structure of the 
reused curr.culunt. Se.ondh . Theme 7 uas strengthened by the inclusion o1 words such^ 
as • tentli ' and "unit" and can now be regarded with greater confidence as a "sensitivity 
theme Tlutdiv . m Munlat lashion. Theme 1 1 is now a much mote powerlul cxpennienial 
mstuictioMs .iieme as a tesult ol the mclusion ot moie relevant words such as "each . 
-amount-, "same" etc. Finally, the lolc ol Theme 8 was clantied as being *nie that re- 
presents picpaiation tor a calibrating activity. 

4 Structure 

Snue I'jits i and 2 ui ihe original core were not rewritten, their structure can be 
leeuded is .omaimnc tlie same. Figure 3 immediately suggests two significant differences 
.vhen compa.ed lo the coric.spondnig sections ol Figure :. Fusily. the icwmten section 
has much more structure and secondly, is mo,o integrated to the point where it can be re- 
iiatded as one action tPaii 3R). It consist> ot a series of sub-sections that either ovtrlap 
;„ a,c connected hv -hndgmg" themes. The exception to tins mtcgranon may be para- 
graphs 73-76 wiu».h act asa c*ue summary. 

Two Miu.tures dominate Part 3R the new theme (Theme 14) which binds the 
earlv sub .ections together and paragraphs 6b-70 where the all-important standardization 
oc.u.s I liese aspects were either nuss.ng or only weakly represented in the original core. 
Theme 14 develops over paragraphs 47-56 and during this development, the need tor a 
Mandard is ned to the measuring and calibrating .skills developed m Parts 1 and 2 and re- 
nuroduced here as a preliminary to the development of the standard umt ot lorce alter 
Theme 14 recedes In the tirst sub-section (46-5 1 ) experimental instructions {Theme 1 1 ) 
on detecting and measuring (Theme 4) and calibrating (Theme 12) forces are reintroduced 
with however, a new ami the development of a standard. Experimental instructions 
(5 vs act as a bridge to the second sub-section (53-57) and an overlapping third sub- 
seJtion ( 56-6: ) w here calibration (Themes 8.12). now using a standard scale, leads to xhe 
emeigencc of the standard unit of force the newton (Theme 7; 59-61 ). 

Theme 14 then acts as a bridge to the last major sub-section of Part 3R (62-70) 
where the standard newton is then used to measure small and large forces. This can be 
.dieted from the donnnance of paragraphs 66-70 by the now strengthened sensitivity 
.heme (Theme ^ ) .md the presence of experimental and evaluation themes (Themes 11.13 
67-68-. Theme H; 68-70). 

Tiie final section ( 72-76) summarizes what has occurred throughout the core, as 
ev Jenced bv the presence of most of the tlieniatic elements, as well as giving instructions 
as to how to piiK-eed with the options in a scient.lk way (Themes 10. 13). This "tying 
UiC together" was lacking in the original cme. 
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^ , Conclusion 

It Jio* seeing ihat "on paper" ihi ievij,ed vetsjon ol ihc core (C^) has more 
p».UMUJal ihaii f to achjcve ihc siaiej objectives of ihe vurnculuju writers. The new th 
lliomc 14 jovl ti>o slienjithciicd I hemcs "> .ind 1 1 . aion^: with the intproveU structure of the 
latter scciiv^iis shoulJ ovcKiniie the uuii3eM»Jaes ot the original cure. One method ol check- 

oti th>> would be t.> c.vupaie tlie ellVcts oj both versions on pupils "in :ne B«' 
lore rcpvuting i«i the tuMd tnal. n should be noted that ('^ is by no means the "best" 
possible vetsion oi tlie core, v"^ it>elt could easily be subjected to further rewriting and 
content analyses any nunihoi of times e g, para. 62-66 may well need further revision. 



Field Trial 

1 OrgantMtion and Samole 

During 1'>"'3- M-ience teachers niider Mr. S. Mackenzie at Waveil State High School 
in BiiNbaiic changed ihc nonnal titadc K tlust secondary year) science program to one of 
eight AStP units. Unir to be done per semester. "Pushes and Pulls" was one of the first 
semester uniiN Due to school orgaiu/ational "problems" <see Clarke; 1973a) eight class 
groups tfimi gioups ol iv^o) weic chosen from an available twelve to act as the sample. The 
gioups woie du'son to avoid »:uHips Ajih unique chatacteristics. to minimize the teacher 
var»able and lo provide an oppomimt\ for icphcatnwis. The sequ'.nce of groups is shown 
in Table 4. 

TABLE 4 









SEQUENCE 


GROUP 


TEACHER 


29/1 


5/3 


2/4 


21/5 






to 


to 


to 


to 








2/3 


30/3 


4/5 


15/6 


I 8A7 


Mrs. A 


P 










Mrs, 


A 


P 








2 8 A3 


Mrs, 


B 




P 






8A5 


Mrs. 


B 




P 






3 8a: 


Mr 


C 






P 




8A4 


Mr. 


C 






P 




4 8A6 


Mr. 


D 








P 


8A10 


Mr. 


D 








P 



^•P" : Pushes and Pulls : Other ASEP units. 
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ta) ASEP biH^klcis, 

In preparing ilie maic ^uU. an anctnpt was made lo niaintam the *'AS1.P aimos^ 
phcic b\ having individual anc and iceoid booklcis and by inaktng ihe reviNcd wn^m 
\eT\ Mmilai in appcaTance ihe onginal version e.g. llie Name illusuaiions m nuKh ibe 
same poMtion^ There were, however, some deviautms from the nornial AStP lomrut xu, 
bookletN were reprodtwed \n u>olNeap lorm aiid a special separate **rhevk Yout Answers'' 
sheet was prepared to replace the ''Turn to p.! H and cheek your answers" type xM m- 
stnutum. The core b\H>klet, rec^nd booklet and *1 heck Your Arn^wets*' sJieeJ tor each 
version had a consistent ci^hnir diJYetence. 

\b) Pre* and Post^iests. 

Short objective pre* and post test^ were produced by the author, Kach teM ct>n- 
tained iwo disiiKct sub tests \Mie sub^tesi ciimamed questions related to ihe section of 
ihc coie !)oi revised ipaia, 3 to 45) and tiie t^thei subtest cmitamed qtiestiiMis lelated to 
the \ection of the cote that was revised (para, 4tv7^ v Details the consnuctum of tliese 
vpiesthuiN. in particulai their elation tv> relevant KX)\. ate available elsewheie K'larke. 
l^>*^.^a) Reliability measures, however, are not yet available. 

. Methodology and Design 

Teachers were given verbal and written instructions (see Clarke. 1^73a) and dur- 
ing the lust **Pushes and Pulls'* meeting, administered the pretest, randomly assigned pupils 
lo control (original ASl:P core) and experimental (revised ASEP core) groups, distributed 
lire bi>oklets and introduced the pupils to the "hardware" they would be handling during 
the unit e.g, force-measurers, sinkers etc. The distribution of the sample to this point of 
time, IS shown in Table 5. The original sample has been reduced t)y 29 so far. due to pupils 
ni>i completing both pre^ and pt)st tests, not having a school record card, transferring to 
another scliool etc. Table 5 shows the reduced figures. 



TABLE 5 



Group 


1 


■» 


3 


4 


Teacher 


A 


B 


C 


D 


Control 


27 


27 


34 




Experimental 


35 


28 


23 


• 


Total 


62 


55 


57 


• 



• Unavailable at this time. 



As each individual finished the core (4-5 forty minute periods) they completed Ihe 
O post-test. The pupils were then issued with the "'reaK' ASEP books and allowed tt) proceed 
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oino ihe opuons 1 lus pic Jcsi , jnvst tcM. comu>i gunip design, wiih landom assignmcm of 
mdividua!;. ix> e\porn«c!Ua! and comiv)! gioups, icgaidod by Campbell and Stanley (1^67: 
IS,^) as a ttue e\pcnniental de^gn, 

ToacluMN and pupsK wore asked u» mdJcaie pn>hlcni aieas ihroughoui the core by 
leachers kcopuig a list ot pupil queNli»>ns lliat related >pecilkaliy to understanding of the 
ctniient ot the coie , and by pupiU marking "sentences or paiagiaphb they had difficulty in 
undctNtandmg. ThiN technique teacher and pupil reports is the most common format- 
ive evaluation technique tLockhard. l^bH) but is regarded b> reviewers of curriculum 
evaluation research tClarke, W73b; bukhard, 1*)68; Welch. 1969) as being of questionable 
use 1.M a numbet ot icasuns e g, the feedback is not suitable to allow changes to be made 
m the matenals A ptehnnnary analysis of the feedback has already shown the advantage 
of contetu analVMs A control poup pupiPs question "Why do we have to change the 
hacks,iw blades rcllects confusion concerning sensitivity. Content analysis of the original 
coio could have predicted such confusion. However, in many cases it seems that teachers 
and pupils aie lUst too busy m the ASfcP classroom to provide feedback. There may be a 
need to provide icachcis and pupils with some structure and system within .vhich they 
could provide usable feedback, or to get the feedback independently of them e g. video- 
tape . 

4 . Results and Discussion 

Scores obtained in the four sub tests were analysed using a stepwise discriminant 
analysis. Results are shown in Table 6, 

TABLE 6 





GROUP 1 


GROUP 2 


caoup 3 


TOTv 




F 


df 


F 


df 


F 


df 


F 


df 


Pre-test sub-test 1 


2. 28 


61 






1.63 


52 


2.01 


172 


sub test 1 


1.23 


59 


0.21 


51 


2.18 


53 






Post-test sub-test 1 


1,64 


60 


0.28 


52 


3.10 


54 


2.95 


173 


sub-test 2 


**3.77 


62 


0.40 


53 


•4.13 


55 


*5.50 


174 
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- insufficient for computation 
• significant at 0.05 level. 

F = 3.9^ is significant at 0,05 level. 

A significant difference betv^cen control and experimental groups was found with 
group 3 and the total sample, while group 1 approached significance, the one discriminator 
in each case being Post-Test sub-te 2 the set of questions related to the rewritten para- 
graphs. Group : differences were not significant but again, the same sub-test discriminated 
most. It seems that some of the ^^instructional evaluation interference*' metnioned at the 
bcgmning of this paper may account lor group 2 results The pupils in this group took 
nearly three times as long to complete the core as did those in groups 1 and 3. (;0-12 



ponods c 1 4^0 pcnods) Ov\m \\ns c\tt*ndod ponod one could see pcrh.qvs an nuiease o\ 
teacher mlluencc ai ihc \*\pense ^ oi ihe toxi uulucnec. 

At this caih stage of data analy^s. tiie icMilts aie very encoujauing hut cati ^niiy 
he accepted wnh optnnistic caution, W1uii has >ei io he done ts \o cs\Ab\\s\\ beyond uMNon- 
able diUibi. the leason tiu tlie Mgntricant ditJeKMue. Hopefully, it wjll he |ust the le\! 
nutenal but other vaTUbles nuy explaui the dilJojence e.^. sex, mtelhgence, verbal abihttes 

c MeaMues ol getuMal scholastic aptitude tmielligenceK v^^nd knowledge and uMdnig 
.o ^^ptehenNuni are available trom the reNuhs oi a standaidi/ed test batteiv adimnisteied to 
all Oueenslaiid state pnmatv schools late rn iIkmi tiiade 7 year and nuihuegression aiiaK bis 
sljoiild isolate tlie discinnniatmg vaiiable 

OiluM coiueniplated anaK sis will be looking toi indAidual t^uisu^^m (as opposed 
to sub-iests) Uiat discninmate between the cuinrol and expenniental gionpi>, a inoje detail- 
ed examinati.^n oi t!ie leachet and pupil 'Meedback \ a look at the elieci of ihe iniie taken 
K^^'MUpKMc ilic coie. atid a look t<M an> "ASl P unnliaiiu" e!leci ihai nia\ enuMgc m the 
lauM g!oup> av a i?suH «M ilicn exposuie U> oiIkm unn> beUue ^'Pushes and Pu!ls"\ 

Summary and C onclusHin 

What has been lepnit^'d hcie is an Kibiective, pie-Uial lonnanve evaiu.iUi^n of ihe 
^oic oi an ASrP unn designed ii>shi>w iispoienn^!! ni terms of themes and stiucnue.a 
le^iMon on liie basis cognnive-l'ield learrmig ilieory o{ ih*>se sections of the c*ne shi)\vn by 
Uie ,inal\ sis Jo be p^vsMhlv dencieni. and an ongoing field-tnal of the original and icMsed 
cores. 

The tield-ina) lesults. liiougli oniv tentative, have demonstrated the w^e of the 
(\nss i N73> CiMitent analvsis leciinique as n nia\ be applied to formative curriculum evalu- 
ation since It supplier* the diagnostic analysis which is at the lieart of lomiaiive 
exaluaium'' (Baumgari, l^^H The lechnujue pri>duces. prior to tield-tnals, usable in- 
t\ninaMon with respect to the potential mlierani m the text, showing lor example where 
structure is pih)r or where there is irrelevant oi loo much information. The technique also 
allows feedback from fleld-tnals to be used more constructively since general statements or 
questions, hitheri*) oi hiile use m giving writers directions for revisitm, can be linked to 
themes, the ciMtteni and distribution of which are available. 

Tiie Use of this technique tor the analysis of the manifest content of cmnmunic- 
aijon-w ritten tu verba! seems unlinnied. The analysis of the teacher and pupils verbal 
communications in parallel with the textual analysis, and the analysis i>f **experi" ideas 
on "wliat Is scienceT'tot^btain i!ie "essence" i>f science are but two. Tlie technique itself 
needs iuriher refhienient and this rermemenl and possible uses offer an interesting challenge 
for future research. 
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REFLECTIONS ON THE SOCIAL CONTENT OF SCtENCE 
EDUCATION MATERIALS 

PehrJ, Femham 

Thii papcj a rencvtion on xhc findings of a research investigation rather than the 
investigation nsclr U c^nild be icviritten in a more traditional form which would suggest 
that a dehbetate plan jnd design had laid i>ut the procedures. In the complex fields of a 
MKial science like educatum, u is. of course, importaiu to keep such planning and design 
m nnnd but us dangeis need also to be remembered. In the physical sciences, good design 
is usually a much simple} matter and caiefuUy planned studies can be carried out. How^ 
ever, many of the mainsprings \oj the more imptntant findings and lines of advance come 
trom the unplanned by-pioducis of earlier investigations, or really critical appraisals ot 
the restricted thmkmg ihat is inevitably associated with a tight design, 

1 he planned study m this case was the development of methods of content anal- 
ysis for use wiih ihe tnatenalb of various science currieula. The content was to be analysed 
for vaiious social dniicjisions. There has been a grtwmg interest since 1968, the year of 
the Dauiion Report, m the social relevanLC o\ science education. 

Tv^o social aspects oi science led to the first twi> dimensions. 

The first is the social nature of science itself. Pragmatically, this is mentioned by 
the Dainlon Comnniiee when it savs diat students should study science because it is one 
.^f ihe great achievements o{ tiumamty and so often provides examples of the best of man^^s 
creativity and inventiveness. The theoretical base for this social dimension of science comes 
from the work of St orer^ Merton^^ and other sociologists of science. Tliey argue that 
science and scientists form a social system with itsiwn value system and special means of 
communication that transcend national and cultural bi>undaries. In science education it 
may be that some of these aspects of scientific work could be appreciated and learnt. 
Several primary level courses have emphasised this point'*. The presence of this dimension 
m the materials i^f a course could take many fomis. Among these would be case studies 
oi scientists and of the exchanges between them that led to the development, and reput- 
ation of experimental results, conc-pts and theories. Exercises that require tile poohng of 
data would be emphasised and teachers, texts and data tables as sources would be re- 
peatedly related to the energies and work of past and contemporary scientists. The con- 
tributions u\ the technicians who he behind apparatus and instruments would be made 
explicit. 

The seciMid social dimension is also to be found in the Dainton Committee's 
critique of the teaching of science in English secondary schools. It is the application of 
scientific knowledge in society technology and all its implications. Examples of past 
and contemporary apphcation of science, and of how scientists were set on the track of 
many of their discoveries fioni real life situations, would be evidence of this dimension 
in the materials of a course. 



The third dimension is derived from ihe second one the niteractii^n ni scien- 
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x\\K knowledge wnh mvkmv It is cnnoiuuIK a soi of ideological positions that has become 
meaningtul n\ relatUMi to the cnuKuluni ol loinia! education since the \eai of ihe Dainton 
Report. It IS hard, only tlve \ears later, to believe that such a majoi repon science 
educauon could be wrinen uuhi^ut \hc phiase '\sociai responsibility of science'' being 
used The environmental issue, the unc oi SRS groupii in many counines and the countei- 
culture nunenienis m these nuej\cnni^ >cais. iiave made us awaie that theie can be dilter* 
nig ideological poMiions about the inieractu^n ol science with vviety. The Dainiim Report 
came at the end of an era when tiie csiabliNhed view of science and of science education was 
tliat it waN good, meet and right so to do\ It is Uiw recognised that. a> well as the position 
that sees applied science as pti^blem solvuig lor si>ciety. there i> a poMiion that nccs h as 
cicaimg problems In other woids, science is viewed as a source foi the inipiovemont o! the 
^uaiitv ot social life or for its deieiioiaiion. Both positions can alsi> be held at iuiee and 
such an ambivalent view i^f apphed science is ntnv increasingly iJje noim. As somi as a 
medicinal bieakthrough i^ announced, the question of its side effects a?c laiscd, etc, 

PnK*vdures and results 

The puKedures for making the ciMiteni analysis on thes^: three dimensuMis have 
been described in detail eisewheie^ The first two dimensions are finally scored on the five 
point scale i). \ery weak, weak, suoi^g. very strong. The last is scored with + and - depend- 
uig tMi \\h^\ posiiion.s a?e imph^nl> *m cxplKUh lakcn in tfie UKlusuin and discussion o{ 
examples oi soluiI application o\ science The number of + ox - signs signif ies in a crude 
manner the strength of iho preseniaiion iif the ideological positions. 

Tahle i shi)ws the results oi the analysis tin a number of chemistry text biioks 
that are used in ctmjunciion with courses in Australia or elsewhere. 



TABLE 1 

Social content of textbooks for 
secondary chemistry courses 
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SOURCE 


SOCIAL CONTENT 


TEXT 


Nature 


Applicition 


Ideology 


C hemist r> I akes Shape 


Johnson and Morrison 
Scotland 


weak 


strxMig 




A Modern Approach 
lo Chemistry 


Stove and Phillips 
Victi>ria. Australia 


weak 


very 
striMig 




Ciieniisiry A 
Structural View 


Siranks cr a! 
Victoria, Australia 


very 
weak 


very 
weak 




( HI :M STl DY 


Parry 
USA, 


very 
weak 


very 
weak 




( B A 


USA, 


weak 


0 


0 


riieniislrv 
The Sample Scheme 


Nuffield Foundation 
Hngland 


weak 


very 
slrtmg 


+ + + 


Chemistiy 


Nuffield Advanced 
Science 
tngland 


weak 


striMig 
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AH the book5* exccpi iJie \hs\ editUMi oi Stove and Phillips are associated with 
cujncular lelonm ot ihc substantial variety that began with the PSSC project in the late 
l^)50's. This exception was the spare lime work of two practising school teachers and was 
a text tor a course that iud known only the minor revisions that science curricula had 
enjoyed for most ot tins centur>* until the 1^60's, Althou^ published in 1963, after the 
major overseas priyects had begun it was unintluenced by them. It was an excellent ex- 
ample ol the >pe of ic a m common use before the project era. 

The data m Table 1 indicate a polarisation of the texts on the second dimension. 
They are either '\ery weak" in social applications of chemistry or ^strong" to "very 
strong". The score on the third dimension is, of course, affected by the result on the 
second so the "weak" texts have a positive position but largely implicitly. The others 
present tlieu positions strongly, but no examples of strong negative positions appear until 
the texts of the late 1960's and 70 

Table 2 presents the results of a similar analysis for the texts of some other scietKe 
course oi this same period. The results are similar. 

TABLE 2 



"Social" content analysis of secondary science materials 





Publishad 


L«vel 


Sci«nc« 
as 


SoctsI 
Application 


tdfloloaical 
Stance 


J.S.SP. 


1967 


7-8 


0 


weak 




Discovery in Science 


1970 


7^0 


0 


weak 




Discovery (Revisea; 


1972 


7-10 


weak 


strong 




Nuffield Combined 


1970 


7-8 


0 


weak 




Nuffield Secondary 


1971 


9-11 


strong 


very 
stiong 


+ 


A S E P, (Aust) 


1974 


7-10 


weak 


very 
strong 




S.CT.S P. (U.K.) 


1974 


9-11 


very 
strong 


very 
strong 




P.S.S.C. Physics 
(U.S.A. & Victoria) 


1959 


11-12 


weak 


very 
weak 




Nuffield *'0" Physics 


1966 


7-11 


0 


weak 





JSSP, early Discovery , PSSC, and Nuffield Combined Science are examples of 
-weak" social content. Nuffield Physics and revised Discovery are more like the **strong" 
group of chemistry texts and the post 1970 ones, Nuffield Secondary Science, ASEP 
and SCISPare all '*very strong". 

The procedures have now been appHed by several analysts to a number of texts 
and consistent scoring is obtained in relation to the defined criterion of the dimensions. 
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We ma> theiet<uo vtMuiudc that AusiiJiati secondan sciciko is suW iatgcly 
gnpped b\ pecuharJy a-sociai courso^. ^nce PSS(\ CHtM ST^l)^' and its dciivatc^, and 
JSSP are very prominent sv>urce materials. Indeed, none of iiie>e CiUHM.^ can cxiit 
apart from their textual materials and the texts have become ihc ciuHie \\n most ttMcheis 
and students. 

Discussion of the results of the analysis 

The resuhs in Tables 1 and 2 can be uuerpreied \n a nun^ber ot ways> One 
simple corielation is to look at the sorts of people who wrote the various *cxts and deter- 
mmed tlte details ot^ the projects ot whicli many of them ti>rm the baste part. If the 
projects are separated mlo those m which research*oriented scientists were prominent 
and thi^se essentially m the hands o! experienced secondaiv teacherj* there is fairly good 
correspondence with the **weak" and '"strong" groups respectively^ Nuffield Combined 
Science, \uftield Physics, JSSP and early DisCiwery seem to be exceptions. Combined 
Science was a pruned amalgam of courses with more social content and m the squee/e the 
Niraight NCieniilic content won precedence, Nuffield PhyMC^ really had a researchM>riented 
person since Rogers moved into academic physics after the piojeci, 

JSSP thimgh written by teachers did draw on academic scientists and had PSSC 
and Chemistry a Structural View as reference points. Discovery was written for course 
outhnes which were still heavily oriented towards university requirements. 

However, this relationship just raises another question, Wliy do these two types 
of persons interpret the content of school science so differently? 

A closer look at some of these curriculum projects does provide part of the answer 
to this more basic question. Any persons writing material for a science course will ask 
the questiiMi. What is the content of the subject I am to write for? 

In the 1950's, Joel Hildebrandt, the doyen dean of Berkeley's chemistry depart- 
ment answered for his subject. Themistr>' is what chemists do*. Cryptic, but profound 
remarks often tend to be misinterpreted and oversimplified. 

A number of the curriculum projects whose material we have considered were 
influenced by the particular philosophiua! approach known as the Structure of Knowledge. 
Allied to the slogan of Sruner* about the learner of physics being like the research phys- 
icist in his laboratory, this appeared to be entirely consistent with the Hildebrandt 
definition. Furthermore it provided the way to put the flesh and bones on to his chemist. 
Hirsi^ and Phenix*. on either side of the Atlantic developed grand schema within which 
the science subjects in the essentials of research type science could be credited with a 
special place, Schwab^ and Zacharias'^ translated the schema for biology and physics and 
B5>CS and PSSC took shape. Less directly . but still using this view that the essential con- 
tent of a science is the substance and syntax of its pure researchers, Pimentil' ^ and Strong' 
fashioned the two chemistry projects in the U.S.A. Nuffield Physics. Victorian Chemistry 
and JSSP i)f all the tUher projects were those most closely in touch with these sources of 
tlic Niruciure t)f knowledge. 
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\x inaikMi luUc to cduLjUon that other philosophers have attacked the validity 
of ihi^i wholo Hnlosi>phKal approach. Its mtlucnce has been strong in education, 
particularly science and will go on being so. 

In his Tccern challenging book. Wl^iifseld has expounded the theory in a way that 
wiH appeal to many educators ai\d ceuainly extend its intluence. He gives an ansv^er to the 

>t basic question secinidaty educaiois arc asking about the curriculum of ihe schooL 
^llie curriculum must therefore draw upon analyses of the nature of knowledge and the 
irhereni human abUuies U develops in order to determine its nature, prior to analyses of 
vKiet\. the learner and the learning process". 

This consequential statement fiom the structure of knowledge theory immediate^ 
l\ explains w h\ llic icxis \n whicli it is an intltience are so weak in social content. It is 
the know iedge for the knowledge sake that is the priority determinant of the content in 
Ihe sJun^l OnK secondar\" are aspects of its relation to society, the characteristics of the 
IvMiner oven how icanuiig iKCUrs, Nti wonder with vast knowledge structures like the 
NvKMKOs, those >c\tMidar> features are ni>i reached in texts of this persuasion. 

Some JienuMs do di> research but the great majority do not. Wliat they do is to 
,ip;M\ existing knowledge m MtuatUMis i>f immediate concern to society? The structure of 
kiuHN ledge i> noi coniian lo Ihldebiandt's dictum, but it relates to only the minor part i>f 
u. Rericwthuis ou ihe di^^nssion of the results. 

If. as 1 )ia\e suggested, there is a clear link between the ^'structure of knowledge" 
plulosi^plu and ihe :.pate of a^social materials for science courses, what Hes behind those 
with J gi^od measure of social ciMitent? 

One explanation would be that their authors were not influenced by the S.O.K. 
onlun through ignorance ot n or because they rejected it in favour of some other frame- 
work tor then wntmgs. As has been pointed out above, the main authors of the ^'strong ' 
social texts were suceessiul secondary school teachers, Pcrhi ps we might argue their re- 
sulting emphases are the natural (mtcome of recognising that motivation is important in 
learmtig Relevant, textual material may enhance the interest of the learner and experienced 
teachers are hkely to be well aware of this. 

However, this explanation is not the only one that can be advanced and the recent 
debate iMi t^ e soeial significance of chemistry suggests that what is occurring here is a 
cv>ntliLt of philosophies. Just because the authors of the "social" materials for science 
cducatiiin do not draw on the structure of knowledge approach does not mean that they 
Jo not have a philosophical approach to the content of their subject. 

A person whose philosophy is essentially pragmatic or utilitarian is very likely 
to perceive the ctmtent of science and its origins in a way that relates it to himself or to 
society more bii^adly. Could a Marxist write a chemistry book like CBA or a physics text 
hke PSS( ' The fact that East European texts for science are also, off occasions, sterile 
soualK iiocs not dispri>ve these philosophical emphases. We would need to be sure that 
the auttiors m tlieso sociaUst countries were in fact wholly integrated persons in their 
pohiKal philost^phy and practice. Many Christian scientists are able to compartmentalise 
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then !ailh and dad> wxnk alnunl coinplctcK, Tiiey can and du wntc dcpO!M>nali5»ed science 
while holding intensely personal. anihropiMnv^iphic lehgious behels. 

However, a Chnsiaui existentiahst iike John Wien-Lewis**^ sees a ciMunuhniJi hnk 
between technology and science wuh ihe formei the real essence of ihe whole aiea. 
SmularK, exphculy MaixiNt^niented sCicntisis hke Joseph Needham^"*. Haldane*^ and 
Beinal^'' ui iheir wnungs lepeaiedK uner-telaied science with its application in society. 

U the content of science educatioti can be detemnned so diftereittly due to the 
vaiious philosophies of knowledge"" held by its writets, then research in science education 
may be likewise atYeetcd. In other words, what sort of questions are we likely to ask ill a 
leseaich sense if we are essentially Using the ^trMcture of knowledge as our philosophical 
base? How would these be difiercnt. asked by persons with a utilitarian position? 

CiHicep! attainment, learning hierarchies and TOl-S type investigations are con- 
gruent with tlie former position and have been major interest areas m the T S A. and 
Australia wiieie "struciure of knt^wledgc"" courses have been popular. DitUision of 
curricula and "supply and demand"' type studies have been best developed m the U.K. 
where the >ctence coutses have retained a higher social <and more utilitarian?) emphasis. 

At ihiN siage in the development of research in science education, there are a 
number of ieasv)ns for us all to step back and critically analyse our efforts from time to 
time. An obvious nne is the fact that much of what we do is because it can be done, and 
ni)t because u is related lo the most important or most basic questions, in all fields of 
research, but education and other social sciences seem particularly susceptible, we must 
not use possibility as an automatic criterion of importance. Myron Atkin*^ at the Kiel 
Conference of 1970 pointed t^ut a second reason that relates to the likelihood that curric- 
ulum evaluation becomes bounded by the terms of reference laid down by the particular 
curriculum being studied. This paper, springing as it does from some findings in content 
analysis, may provide yet another reason related to the philosophical frameworks from 
which we work, 
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CONTENT ANALYSIS CRITERIA FOR ENVIRONMENTAL EDUCATION 

H D Linke 

L Emironmenial Emphu>i> 

IhiN index lopioNoiHs a measure of explicit emphasis associated wiih the theme 
oi anthrt^poceninc oinnonmental tnteractu>n, or the relationship between man and his 
nsiiuial ihu^logKal and ph\ Mcal ) environment- The assessment is based on a lour-puint 
umuf scale, as shown m ihe lable below, and is dcternnned by the degree oi r<?cufrenee, or 
tiequencv disinbunon. ot statements which mcorporate some torjn ot explicit interaction 
between man and Ins biopin MCal environment. This condition excludes all moral, social, 
eCiMunruc and pi^hiicai issues. unle» lelated to some aspect o! the natural environment. 
Thus a rclerence population control based only on moral or social issues (example 1 ) 
wtnikl not he cljssUied as a statement <>! environmental interaction, although relation to 
nuMC piactical ]>iohlcms ^example 2 1 may justiJy positive classitication. In a similar way 
\]w discUssion of cctint>nuc and political issues ^example need not involve any form i)f 
environmental uuci jcOi»n, unless related to the ptoduciion or cvmsumption of specific 
resiHirces texamplc 4), It should also be emphasised that ecological issues, although con- 
cerned bv detimtuMi with ihc natural environment, inust also be related in someway to 
n^an, acciuding to liic ..nier^ni o! explicit ani)iti>pocentric interaction. 



EXAMPLES 

1. "Infanticide allows for selection of personal characteristics of the offspring such 
as sex and physical condition. Motivating factors can be ritual or economic. In some 
sivieties twins are considered unpropitious and <w or both may be killed. Other 
societies consider them a highly favourable omen/' (Benedict 1970: p. 173) 

2^ "Infanticide fiU economic reasons seems to be closely linked with the food supply. 
It occurs imong peoples living in very harsh environments, in very restricted environ- 
ments such as small islands, or among those living in great poverty. In such societies 
it is usually female infants who are killed, and this factor is closely linked to other 
aspects of the social structure," (Benedict 1970: p. 174), 

3. "A high rate of investment is a necessary condition for a strong rate of economic 
growth, especially when capital-widening investment is as demanding of resources as 
it ts in Australia. But a high rate of investment is not a sufficient condition for strong 
growth: capital has t*) be directed to economic and efficient uses." (McMahon 
1972: p.295)- 

4, ' The huge investments in the mining industry have yet to fully pay off in terms of 
national growth. The same could be said of much investment in manufacturing in- 
dustry in recent years, or the large development investments the Government has 
underiaken beef ri)ads are an example/* (McMahon 1972; p. 294). 
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Fr«qu«ncy of Reference to Human/Environmental 
Interaction 

Rating 

0 Nov*\plk!? interacuon rckrcnc<^5», 

1 Ret^RMwej* rare or widely disper^^d, 

: Occasional or iniermittcnt ti^teunices. 
3 Consistent or recurrent references. 



11. Qualitative Classificaiion of Environmental Interaction 

Tins index rertecis an overall impression of explicit attitude m approach toward 
lite nature of human/environnient;J interaction, together with a measure ol nitensity relat- 
ed to the presentation of this position. The object of inieracliun is irrelevant to this index 
and may enher be man. some part of the biophysical environment exclusive o* man, or 
hoih, Mnce these are in practice mextncably telaied, aiid thus the effects* of inieiacuun in 
the long term mutually detemnned. 

Tfie assessment is based ou a five point classification scheme, as shown in the 
table beUw. .Mihough the qualitative divisiotis are not mutually exclusive, in that a single 
unit ma\ present both positive (concordant or beneficial) and negative (conflicting or 
detrimental) aspects of human environmental inter;. m (example 1 h each of these divis- 
ions is limited to a single rating of overall intensity. These ratings, however, tiecd not be 
the same, and may be used to reflect a differential emphasis on positive or negative aspects 
of environmental interaction. It should be emphasised, on the other hand, that a neutral 
rating (example 2) logically precludes any additional qualitative classification. It should 
als4> be stressed that the assessment of predominant emphasis prevents the classification of 
any isolated reference to concordant or conflicting interaction, unless substantiated with 
addiiii>nai qualification or appropriately positioned to maximise the overall impression. 



EXAMPLES 

1, used with care, and at minimum doses, has successfully coijtroHed in- 
sects in many countries, and has usually done so without any recognisable harmful 
side effects. Used in ways which we now consider unwise it has done a great deal of 
damage to wild life," (Mellanby 1970: p. 123). 

2. "It is possible to treat considerable areas of woodland with D-DT, without 
necessarily causing haviK to wild life, if suitable precautions are taken, minimum 
doses are used, and the operation is not too often repeated/' (Mellanby 1970: 

p 124). 
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Classification Intensity Intarpratation 

SiTong Concordaiu ut consihcnl relationship. i*xpress* 

ing beneticial aspects ol huinan/enviummcnial 
't Miidctjic vnteraction. 

\o cxplku i^iaiKC on qualitative relationship, or 
uo expression ol beneficial or detrimental influ* 
^ " ence assoLiated with human/environmenta! 

interaction. 

Modeiaic Disc\udani or contltcting relationship, express^ 

nig detrimental aspects of human/environmental 
Stiong interaction. 



111. Coniiervalional Appn>ach 

This index is concotned with explicit coni^iderations o1 environmental conservation, 
which m general lenns releis \o the long-term management and beneficial use of both 
natural and artoicul revmrceN (Barwick 1^71. Wright 1*)70^ The classification of con^ 
servational approach, w hich is based on tlucc independent divisions or categories defined 
m the table belou\ is detormiped by an overall assessment or impiession of predominant 
emphasis, and involves nn latmg of degree. Thus an isolated reference to conservational 
unplications (example 1 ) Wi^uld probabiy not produce an impression of general concern, or 
positive cbssificauon. unless substantiated with additional information (example 2) or 
appropriately positioned io maximise the overall emphasis or impact. 



CXAMPtES 

1. •The annual harvest (of kangaroos) should not exceed the equivalent of the 
natural increment, lhai is the number of young produced that can be expected to 
reach maturity/' (Ratchfie 1970: 

2. ••An industry based on the cropping of a wild animal population which docs not 
accept the restraint implicit in this principle is doomed to self-destruction because 

it will eat into the living resource on which it depends, and usually ai a progressively 
increased rate/' (RaicHffe 1970: p.5). 

Classification Intarpiatation 

Negative or anti-conservaiional approach, involving explicit 
rejection of long-term considerations, or denial of concern 
for possible resource limitations and associated problems of 
management. 

Indifferent or non-conse vational approach, involving neglect 
of conservational implications and suggesting no explicit 
reference to long-term considerations of resource limitation 
Q and management. 
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^ PoMtive von>oi\anon,ii apptojclu inxolvm^ uvognuion 

problems o! longicnii inana^enuMU. 

iV. Iiimitive Intemity 

Hus index um>Kesa Mibjectne assesbOKMit ot genoial cnu)ljve unpac] oi :nu*nsnv\ 
and IN ba^kCd on a lour point laung scale as shown ni the table beknv. The assessmeni ol 
emoiuc iniensijy is noi nece^sa!ily associated with aju pamcular environmental reJerenco 
%u theme, and should niNiead take general acCiUint oi the Uequency. pvjsitum and iniensiiy 
ol aU emoiive statemenis AlthiUigh nilluenced b\ lecunence oj repetition, n Nhuuld be 
emphasised that the assessment of overall intenNitN uUi^lves more than a bask treipiency 
coum of emotive words and phiases. Mnce these, U taken oip o1 \i>nte\t, ma\ U)se their 
emotue impaci or present a false impressu)n \i| strong emoiiiMiahty, For example the 
teiniN ^'desuoy ^ ''wipe \ and 'Eradicate", ahhougji apparenily synonymims, may all 
be used m a mure t)r less emotive sense, depending on the general context m which they 
occur. Moreover . Willi respect t\) position, a single emotive sratemem is likely t*^ be sii<mg« 
er in terms \)f general impact if placed near the start of a passage rather than inserted else- 
where since ihis may mcrease sxmphaihetically the impact oi subsequent siatemenis, and 
in fact the emotive intensity any individual statement may similarly increase the impact 
ol otheis arijund, Thub the examples ouihned m tiie table below are suggested only as 
possible indications of appropriate rating divisions, and in this sense assume Si>me consist* 
ency of presentation style. 

Example 

' It is well established that pesticides present in small amounts 
in water can be concentrated many-fold by aquatic organisms, 
including algae, and that the degree of concentration may 
thereby increase from link to link in the food chain," 
(World Health Organisation 1968: p. 55). 

"Besides being direct threats to Imman health, synthetic 
insecticides are among man s most potent tools for simpHfy- 
ing ecosystems. The increase in concentration of the most 
persistent of these compounds with each upward step in a 
food chain exposes the populations least able to survive 
poisoning to the highest concentrations," (Ehrlich and 
Ehrhch 1970: p,167). 

•*Wr are poisoning plants on land and in the sea in various 
wav s at an alarming rate. An estimated three thousand 
chv ncal ci>mpounds have been added to the atmosphere 
by i ian. and we are dumping as many as half a million 
polAiiant substances into the oceans." {Ehrlich and Ehrlich 
H70 pJ90|, 

"The history of the recent centuries has its black passages 



_ , Emotive 
Rating 

Intensity 

0 None 



Weak 



Moderate 



Strong 



lUc NliughuM of \hc bu!talo on tlie Wcsttnn plains, the mass> 
avjc o! ihe ^iu>Ie-bHd^by U)c maikei gunneis. ihe near- 
cxKMHunanon of ihe egrets for *heu plumage Now. tu these 
and others like ihenu we are adding: unew chapter and a new 
kind ot iuvtK' tlie diieci killing uf buds, nianimals. fishes, 
and indeed practkally every form tif wildhte by chemical 
mseciivjde> indiscriminaiely sprayed on the land/' (Carson 

V QuaiUitative Emphasis 

I hiN mde\ reflects the degiee uf lefeience to various forms of stalisticai inform- 
ation The .^^^o^Mnent j> ha>ed on a Jour'pt>nu ratmg scale, as shown m table 1 below, and 
IN deienmncd b\ the degiec of iccurrence. ot frequency disinbution, of reference lo numer- 
K j1 oi M.inNik.i! data, ThiN data may either be presented in the text, or given separately 
m t.iblcs, dugiains giapli> ot pkional legends. Since the mdex is intended to measure the 
heqiietKA ot lototencc rather than the absolute number of figures, tables of multiple data 
Nluuiid he Ja^^Uled comptehensnely a!s single examples, unless further reference is made 
to the tnfoim.ition iluought>ui tiie text, C a^es of multiple reference \o tire same individual 
uom data Niiould also be clasMfied a:* snigle examples, although an individual statement 
mciupoiaiiiig ditfeient numencal examples may justify nmltiple classification. General 
^ompatatne NtaiemeiU^ ^uch as *"more" or "les:^" should not be cla:i:ii!ied as examples o\ 
Niatisiical reference unle^^ quahtled by more spccitic quantitative terms, althougli the^^e 
nu\ mclude approximaiioiiN. <uch ^s fractional estimates or rtumded percentages. 

The general raung of quantitative emphasis (table 1 ) is independent of any refer- 
ence to enviiontnenial interaction, and sliould account for every instance of statistical 
u vumaiion. The conditional rating, however, outlined in table 2, involves an assessment 
ol tlic overall proportion of references to :.latisncal information which are directly or 
explicitly associated with some aspect of the humna/environmental interaction theme. 
This rating is not hnrited by the first, provided that the general rating is positive, since a 
unit which refers infrequently lo slaiisiical mformation may still have a high proportion of 
envuomnenial datr , The only hmitmg condition for this mdex is therefore one of relevance 
to the environmental theme outlined above. 

Frequency cf Roieienoe to Statistical information 

No reference to statistical data. 
Rare or scant reference to data. 
Occasional or intermittent reference lo data. 
Consistent or recurrent reference to data. 

Proportion of Statistical References 

0 25% 

25 50% 

50 75% 

75 100^'? 



( 1 ) General Rating 

0 
1 



<2) 



3 

Environmental 
Rating 

0 

1 
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M Pictorial EmphuMs 

Tins index i."nocis ihc dcgioc o\ lotcicncc \aihUiN liMUib ot puUMUil lopiosciH- 
xiUxMi Ihc as^OssmoiH i^ba^cd ou a Joiu-point ^ating NCak-, aN nIuhmi m labic 1 bolovv, and 
i> dotonnnu^d b\ {\w ovoial] ttcqiKMKX o| uMcioni^c i*^ piuMt^iiUiplis. diawnigs, mapN, v haiiN, 
paphs and other pKtxUial tv>uns. 1 oniposuc pjcuncs x>i graplis Njunud be elasMfied as Mngle 
examples, unlevs nuoKnig nuilnple leteiencc in the ie\! diOeieni aspeeis of nnorination. 
h\ ih\s w'ase eaeh leleienee siunUd be classitied a^> a j^cparate example, fl should be oniphas- 
jNed. peihans, that this index ib nidcpendent ot pwtonal area o\ >\/c, ahlunigh the iuerali 
uuuii: nu\ be miluetieed b\ poMiinn \n disinbuiion. As expiauiod tot n^ Jcx \\ tlie general 
lanng pKtoiial empiuiMs Uable ! ) is independent of any reieienee 'o onvinMimental 
inteKK thMK and should aee»uint foi e\ei\ n^stanee oi pietxm.ii ivpieseniaiion, while tfie 
eonduuMial latnig of prv^piution (\uitlined ui table 2 ) nivoKes some hMin oj* explicit a^MK- 
latioii \snh the human envnonnienial nueiactu^n theme. Tins lelaiiiMiship should euhei 
be explamed \n the text or iHithned in the appropriate legend, and ci^n^tuutes an essential 
v^'iuhnun Uvi envnoinneniai cla^jsineacion- 

\ I ) General Rating 
0 
1 

s 

3 

Environmental 
Rating 

0 
1 

3 

VII. P^r^op-iMivvolvement (A) Intellectual Activities 

This index refleeis. for materials with an educational role, ihc degree of personal 
or student involvement initialed through various intellectual activities. The general assess- 
ment is based on a four-point rating scale, as shown in table 1 , and is determined by the 
iuerall frequency of reference to all intellectual activities, irrespective of environmental 
relevance. These aeiivities may include questions, directions for further reading or literary 
research, written assignments involving recall or rational argument, and a range of similar 
UH ellectual problems. Composite questions or activities should be classified as single 
examples, and rhetorical qucstiims. for which answers are subsequently given in the text, 
should not be included at all in this assessment. The presentation of activities in terminal 
izroups. while probably justifying multiple classification, need not involve separate con- 
.idetaium foi each oxi^mplc, unless additional reference is made to these activities in the 
text. The conditional rating (outlined in table 2) involves an assessment of the overall 
proportitm of intellectual activities explicitly associated with some aspect of the human/ 
envui^nmental interaction theme. 



Frequency of Reference to Pictorial Representation 

No reference \o pictoiial representation. 
Raie ot scant pictonal reference. 
Occasional ox uueiniiuent pictinial lefoience. 
Consisien* or recurrent pictonal leference. 

Proportion of Pictorial References 

0 25; 

25 50^:; 
50 ly'r 

75 - 100'y 



\ \ ) G(?n«*r«)) Halting 
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Frequency of Reference to Intellectual Activities 



Proportion of Intellectual Activities 

:? 50 ^ 

"5 lOU ■ 



\ 111 IVrsoiKil ln\t)hiMium I Pnutica! Activities 

doiZioc-l nnohcnioiu mUKitod ilirough pracncal 

n!-.ak1» ;n \ 1 i^ vic!v^!iMiK J b> tlu- .noi.dl HcquciKA of toloronco all oxpcrmuMU- 

^ .r- -1 piuNK.il i:-.;MjKin.^M ps) 'i ^kllL apau turn au\ .opuiwc oi lulolkvl- 

.^^^c^M:KMU ( >-r,p<.>r;/ .^\;\MHiiOinN acinUJCN sl^Mild tv ^■]a^^)!u^i a^ Muiiic cxamplcN. 
utulj !!i->NC iMCN.-^^jJ ih UM!iunal glollp^. .ilih.nigh pi^bahK iUn1i!\ lug niuhipio JasMlk- 
.iM luvd iir.-ho vpaKiic ..M^MJoiaiion loi a.n\n> . inilcss jadnuMial ivIctoiKO 
iMHadoioilK^va.UMno.in iho I he .^uidilhMial laniig <ouilinod in iahlc 2) involves 

an a^^e^^nKMU -I \\w .Aoial! piop^Mtion piaciual a."tnnios cxplKiiK assnaated wiih 
aspovl \hc lianian oinuoninonial nuoiaCUP!^ ihonuv 



Genera! Rating 



0 



Environmental 
R jting 

U 

1 



Frequency of Reference to Practical Activities 

Nt> lOtOKMKc to p!aciiv.a! av.Mniiios 
RarotM Nv.atH icIciciKO. 
Ckv.aMonal or inUMnniteiU lot'iMcnce. 
(\^nsistont or rev.urronl rctereiKO. 

Proportion of Practical Activities 



0 
25 

50 75"; 
75 100'; 
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PART IV 
RESEARCH TECHNIQUES 



BES1 COPY HVMUBli ' 

SOME ASPECTS OF METHODS FOR PLACING PEOPLE IN GROUPS 



On >vvaM^ni u\ ro>cjKli u nui\ be ik\csvii\ dnidc j ^unip pci^plo on whom 
mcaMiTcniciiiN Ikao boon made inhisKuiloi uioupsoi nimc sinuiai luMnugoneouN types. 
An oviiuplo }> pj^Aklvvi b\ Ihoobald s** o!i-ii»Mn^ ioscaiJ) int^> the ctiect t>t reaching styles 
x^u \an»niN >uuicni *nUvonK> Snk*c n is noi joalh possible lo Jnoct icachots lo use one 
sule an.^TiuM Vhex^b.iki is uMtii: a iuuiibci ol Teacbeis, and is claNMhuig ihcm into one 
st\lc oi jiuwIuN Ibc ilaNsUu anon ui\ol\es niakn^ii auduMapes several lessons given by 
each teachcj ihioughtun \he \eai. and tb*M) anai\ suig ilien behaviour by a Fianders-xype 
sxsiejM vviikh i^nes ihem svojes on some fitix \anables. Hie leaelieis aie then lobe 5»plit 
so i!uM Uh»se \* hose s^oies vmi ihe int\-iidd \anables aie sinulai ate placed in ihe same 
iijoup The i:ioupN u ill i!»en he couipaied \\\\h K\specl io then pupiFs scmes on tests ot 
\A]h uis oiiK ^^nies 

Alnh>ui:h n is Mniple lo sa\ iliai people will be giouped on ihe basis o^ luw 
snniiaf Jhen nv^mos .n^^ on a set ot' tests, tlie piobleni ot iiiiw to go about the grouping is 
inoje subtle than nia\ lijsi appear. Some oi tiie subtleties, and two sohUjiMis, are describ- 
ed bnellx beiow Anothei iniroductoi\ iieatineni ol' ihe purpvjsesand pioblems of 
vluNionn^ b.js b.-on cw.^m b\ 1 atsuoka { l'^^ } >i :sA) 

Measures of similarity 

Figure \ shi>ws a liypoth'Mical set ofscoies lor three people. How can these 
scores be reduced to single indices which will 







1 




3 


4 




J oh 


0 




6 


1 


Persmi 


Robert 




3 


-4 


0 




Dick 


8 


10 


-4 


4 



Future K Hypothetical set i>f scores for three people. 

indicate the degree of similarity between each pair of the three? Perhaps the most obvious 
is the Pythagi>rean distance between them. In this example the value for the distance 
between Ji^h and Robert is 

v/(0 + ( : 3)2 ^ <6 ( 4))' ^ C 0)^ = \\5 



Ib4 



{: . an aKo ho usod \u xha poupm^ \c^:\m^uc nncnJcd h\ ( aUell and CvnilUM. knvu\n as 
\ j\«ni*>nic U'attoU and I'oultci CaiioH and Coulter aiguo. howcvci. io\ Uio unc 

'.-UMd ,1 n.in>}ojnia!UMi o\ \iw dixiaiUv^ mio a MnMiainx incasiiK* knvnvn ,in 

r - 

i; + d- 

Wkmc K is the e\]xvled value oi d^ lor a pair t">f pci^ple chosen ai randonv 1 oi 
'M.-N whieh are distnbured n\MniaU\ wuh >iandard devuuion KO, I: is equal ti> uvue il^e 
;nedian i>0 ^ )ohi square vai\ie toi iiunibei i>l degtees oi lVeedv)m equal to the nunihei o\ 

jes \\n each person, d is Hie P\ ihajzoiean distance between the pair. It can be seen 
Uiai when d - 0, r - \ . when d - t. i = 0. and when d approaclies nitirnty, r appioaches 
' I 

A q\]ite dilterent snnihutty measure rs the ciirrelaiion between one person s sei 
t»1 sci>res and another's. This measure is used nr Stephenson's ( 1^3b) clusiernrg method. 
and Is al>o known as 0 technique, ix sul ters t loni the disadvantage that \i iwcrlooks ditler- 
eiences in degree with which amibutes are held. The C4)rrelaiion between Dick's and 
Kobeu's sctnes \n figuie 1 is, l\u example, KO, mdicating thai Dick and Roben are idennc- 
al when tfiev clearly are not. 

Meaning of similarity 

Once a measure oi degree of similarity is selected, it must be determined what 
*eally is meant by "sanilar" and by "groups of similar people," 

In defining "similar", the choice lies between definitions in continuous or 
dichi>tv>mous terms. Jf similarity is seen as a continuous thing, then the measure of simil- 
arity tha^ has been selected will do quite well as an operational definition of similarity. 
However, one might want to say that there is a threshold of similarity: if two people ar€ 
closer ti>gether than this threshi>ld value, they are counted as similar; if further apart, as 
dissimilar, totally and absolutely, not as a matter of degree. Which choice is made is up to 
the researcher. Some techniques, such as H-group. are based on a continuous definition of 
similarity, while Cattell and Coulter's Taxtmome is based on a dichotomous definition. It 
w ill be seen that the dichoti>mous detlniiion introduces a further point of arbitrariness, the 
placmg of the threshold between similar and dissimilar. The final form of the groups of 
people is heavily dependent on just what is accepted as similar- To expand this briefly, if 
loo broad a thresliold is specified, everyone will be found to fall in ( ,ie large group, while 
if t4H> narrow a one is used no one will be found to be similar at all to anyone else. 

In defining what is meant by "groups of similar people", there is a choice between 
w hat may be called * clumping" and "contiguous chains". Consider the distribution of 
people. wh4> have been measured on two attributes, which is shown in figure 2. 
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Scoic \>i^ variable ! 



1 1^ 11 TO 2 . H> ptuhcticai distribinioii t>l pci'iplo on iwo vanoblcs. 



\n A clinnping schcirtC u wruld be prt^babic thai, it the people were forced into 
luo uixHips, the clu>»ieTj. A and C Wi)uld be m one group, and B in the other. In a con- 
tl4Zuou> chain NehtMne A wt>uld be m t>ne grt>up, and clusters B and C in tlie tUhcr. Con- 
Nidei the three pet>plc marked 1 , 2, and 3. Tlie clumping seheme wtudd put 1 and 2 
tt^gether, because ihe\ liave a small separatum. Person 3 would n<n be put with 1 or 2 
because ii is l,n t'loiu them. Tlie chaining seiieme WH)u]d not link 1 and 2 because there is 
a chasm between them, a chasm tiiat \isno\ bridged by a chain ot "similar'' people. Person 
2 IS c*>nne^ted lo 3 by a chain ot pet>ple, st> they would be grouped together. Which 
delimtion one ehoi^ses is a matter tor consideration. H group is a clumpitig scheme, 
Taxonome a contiguous ciiam sclieme. 

Methods of forming groups 

A!thi>ugh the distitietuM? between clumping and contigutuis chain schemes was 
\)utlined in the previt)us sectu)n, mt>re needs tt> be said about lu)w these procedures operate 
\o bring out the second type of" ditTerence between H grtuip and Taxonome. This is the 
disiincthm between what may be called InerarchicaL dendritic, i)r agglomcraMve methods 
and uislanlaneous *m singular mel!u)ds- 

One form ot agglomeiative metlu>d is to start with all the N people in N groups of 
i)ne peison eacli. Twt» people are then placed in a single group, so that there are now (N-2) 
croups o! one. and ^Mie group ol iwo. a tt)ial of (N-1 ) grt)ups. This process of merging 

erIc - 



i:ioup>, tnic pan ai a tinu\ is cuntu>iK\l unni cxouono 5n in one lai^ic guuip N Ihc 
cUteiuMi hM wliwli pan i^t iiiiuips is \o ho nioijiod is anxMluM nuUUM ^iuM^o It umiU he 
lo ^oui the gunips wnh ihe cit>sOsi ^"oniioidN. o] n could he ti^ jouj 1ho^e whuh e.uise ihe 
v.nallcM adduhin \o the sum of NquaieN ot seojos wiUun ^loiips, as H ^ioup d^^s, \x 
<ou]d he sonic oihe lUeuou. 

Olhei dendnuc nuMhikl> aie po^s^lh]e One i.»Mild, h>T c\Jtnpk\ sun unh o\ei>- 
\Mie in one gtoup^jj^L^iw^Mia^^nnip imo t\vt\ then each tlu' new jiunips nno lutv ,ind 
st^ on until iii^ftoups of one j» e aTtOTrrtl^Jiii* geneial chaiaetetisnc ol the^e nkM!u^d^ ol tiu* 
tuM upe^N that iiie\ piovide N solutions, \ox the pet^ple divided nnx> 1. . . Ngioups 

in voniiast . nist.iutaneouN oi smguhn nlelhv1d^ ^ne vmi1\ mie jijouping^ hi lax^nv 
oHKvihe fnst Nteni> to ,.\iicuiatea >uiMiant\ niainx.whieh eiMitains value^ ot i .01 
1*\ ihj^orea!) diNianee. OT x.inieljtUMi eoetYkiein , o? wh^'itcvcT Munlainx meaMue has he»Mi 
^elee!e^i 1 Ins nijtux is tlien leplaeed hy a eoiiespinidin^ vMie wlneh uidkates winch paub 

peopit' come wuhni ihe tineshiMd Mnnlaniy I. inked clidins ot pc^^ple aie then scaich- 
vd toi, and tin.ilK speciJicd in leims o] then memher>. How man> siuh Jiams liicic .no 
vJiHUit he ! >ieto|d theie is ni» gujraniee Uiat iheie will ho tN\i> gioupN, o! one, 01 N Die 
nuinhei can he manipulaied . ho\ve\er\ hv ahenng ihe dehnith^n xd ihe Mmilant\ lineshold, 
01 h\ alicnne the delnmion oj ihe sirengih ol" a hnk insiead ot sayniji thai luonnnualK 
Mjndaf pe^^pie . onsiinne a link heiween t\\»^ ^Mheis. oiie can (>ieak Imksand so mciease the 
luunhei ot eunips h> sa> m^ lii u lor two people k> he linked ihey must ha\e ai least three. 
iM tour, or ii\e mutualK siinilai paiiners. 

Summary 

The distinctions hetueen M gr^^up and Taxononie are sunnnanzed in figure 3, 
There are i>ther grouping schemes, hut these iwo were chtjsen to illustrate some ot^ the 
lechmqucs and prt>hlems in grouping people. 
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Fi gure 3> Typc!^ of grouping scheme* 



" r^^ BEST cow AUAItABlE 

U Uas bvvn }Um Ukmv au^ soncijI inoK' ui'lONs.ijhUiaiN dCviMon> be taken 

m .AUMu^ -lU .^n^up^r.i: \ ^-.vM^u! J Mnn!jnl\ has 10 bo soioctcd i>no )ms decide 
Kmw.'Oi^ ..^ntmu^^uv ,iiui a di JuUomous dennuion J01 MiiuUniv useir one has \o chi>i)se 
honxeen .1 Jumpvd a Auuvx\\ uwMum io^ ^nMips a dondnuc 01 a singubr solutmus 
h.i> ui W;^^ 'n'^itiv ::K'th.vas ^u^li as H eiow]^ the main piohlem in wheie to 

Nb'^^ WlijJ^ !Mo -i.-upiiiiis Uh- hext ^ When iheie ate two. Uuee, foui. how many 
-i.'ups' UjH: 1 !\>>:h.nK\ jv .^hleins au* at wiui \a!\ies to set tite thre>lu^id ot Nnnilaniy 
;M,,t h.n\ M;nilu K Miuilai ' and how ntan\ pcviple ate needed tv) eon^siitute a hnk be- 
^^Jhv- p.'.^pK' l!)e pK'NCDve these pi*ihlcn\v whUe they peihaps anno> the 
t-svMulKM wii^» w.ints vjiiuk. iinat>iu.iMe ai^vwets. makes the ptoeess v^V j^ioupm^ ijehe) m 
unc:eNt ,inxi moK' Jasmin. itjni: than would utiteiwiscbe the caj^e. 

RtFtRENCtS 

( ai^.'il K H .Mid i ^mhci . M A Piincipl.^s 4>t behaviouia! taxvMiomy and the mathematical 
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ANALYSIS OF COVARIANCE FOR COMPARISONS OF CHANGE' 

H^lrry Mi ttdw 

in Oihkanonai and ps\chnlv)^Kal iv^oauh u i>i oUon vci> dillicuil to makv valid 
^:oinpa)jNonN ^luup peifounancOs at Uic end the cxpenmoni, becau^ie ihc groups used 
aic >oidinn cqunalom hoioiohand 1 he usual pioceduie ui >uch cases has been to base (lie 
^oinpaiisiUiN ini nuMNUics clungc. 

levlnuqucN \ o\ anaKsinii changes in group periinmance can bo separated into two 
vaiegoncN \u one caiegois aie those te^hnupies whicli eomparc groups on the total change 
iioni nunal io u\u\ siauis \ c. ahs^^hifc f^U2fi^<\ In the other categoty are those techniques 
which Ci^npate gjonps on iMijy ihat pari 4)1 the Una! status winch canni)! be predicted Irom 
the nuttal staUK t e iHiprcdu rdhic cluifigc ox residual change. 

Unli eithei absolute change or unpredictable change, the change iiselt nray be 
valculaied Horn >^^(rr^J scnn s on pretest and pt^silOst or friMti estimates of irae scores. 

\mi\ses of Absolute Change 

Ihe >iniplcNi measuie oj absolute change is the ditference between the observed 
scoies tMi the pretest and posiicsi. There are iwi> precisely equivalent ways iit analysing 
such chaiige scores obtained for different groups. One way is to use an analysis of variance 
( ANOVA) wtih tlie change scmes as the dependent variable. The hypothesis of no differ- 
ences among the groups m the extent o\ their change can then be tested wiifi the E^ratio 
for ihe Between gnmps effect 

The other was is to use a repeated measures ANOVA with the observed pretest and 
positesi sciues iliemselves serving as the dependent variables. The hypothesis of no differ- 
ences among the groups in the extent of their change can then be tested with the F-ratio for 
the groups \ occasions interactuni effect. The twi^ F-raiios will be identical (Werts & Lmn, 
1^)71) 

A major weakness in these analyses wuh observed scores is that the estimates of 
change are usually quite unreliable. Real changes in status arc confounded with cltanges due 
to regression to the mean, a phenomenon arising from the unrcliabiHty of the measures. 
These difficulties can be overcome to some extent by using estimates of true scores rather than 
observed sciues. Techniques for deriving both simple and multiple regression estimates of 
absolute true change are described by Cronbach and Furby {\910) and O'Connor (1970, 
1971). 

Analyses of Unpredictable Change 

Sciues on a post lest can be partitioned into iwt^ components one hnearly pre- 
dictable from the pretest, the other (residual) unpredictable from the pretest Analy^rs of 



1 Suiamar\ *»f isvius di>in>sfJ in >fniinjr jf ih«r Annujli onftrfenttf of fhtr Austrjiwfi Science I aucafinn 
Ht'^i'jfih AssiKUiiMn. Hristi.inr. Mo\ \9'^2 C opies of a fuller version of Ihis p^per .ire .ivjilaMe from 
Ihe juthor 



One ua\ i> io paTUUon caJi tiulmdiurN poNUvsi swi^ic as U^^SKnlvd and use iho 
ujipivduiabJc pxMtioiiN as the dopondctn ^a^ablo ui an ANOV A \ niou^ dju\i \va\ k 
phAidod b\ anaK^s LovauaiKO t A\l'l)\ A)\\ni^ \\w p»*snoM as dopiMuicin \anablc and 
the ptotcsi as K:ov;*!nUc In \NCX)\ A, the anai\>;s js pet! Mined jhe p^sueNi .uliust^^l 
t^M d^^e^enee^ in the pjetesi 

Hiese mi> prov'^Miues. while eoneepuialK ihe same, aio e^MnpuialUMUiilv dUteuM):. 
1 he sum sqiiaies betvveen gjoups m \hc ANl)V A vviih unpiedidable ehaniie voie> v^ill 
be gUMKM ihan ihc ad^u^^^^^J "^^^i^^ v^iiaiej^ beuveen ^loups \u A\< ()\ A H oeJnan. I*J5"K 
ANCH)V A piiAides the betiei icsx oi the h\ poiheMs liuu liuMe aie n*^ diHeieiueN anmng 
iheguHipsin theexKMU ol iheu unpicdieuble change. 

I !uehahihl> i^! i^bsejved seojes ad\tMNeK aUee^N anahses ot unptedwlable changes, 
^usi asii does iliose of absohne changes. VaJiou> pMKedure\ !oj esunuiung unpiedK^ahle 
line vi^anjje are desenbed b> CriMibaeh and hinbs \ V^^i)) AdapiatixnH lo A\< ()VA, based 
on ihese esumate^. are desLiihed in deiail in Medaw ( lw72a) and aie ouihned \\\ MeC^aw 
I I'^^'Zb^ rhe> are suniniari^'od beU^U - 

Absolufc vs Utipred ;able C haiige 

The ehoiee of whether U^ Uvus i>n absolute or unpredietable change m the compar- 
iM>n oi^unipsi is fundanienial, hi the case unpredieiajle change. lennnal Ironi the post- 
test >co!e tit' iliat pomon predictable titnn the pretest is ev^uivalont to removing the pretest 
score nsch plus any component of the absolute change predictable from the pretest, !n the 
case ot absolute change, course, only the pretest score usell" is removed from the posttesi 
score. 

hi an expernnent wnh gn^ups dilYering m imiial status, the most appr*ipriate way 
to » jke comparisions i^f pi^st-expcriment performance would be tii remove f r<im the post- 
test scores the etYeciN of boili differences in pietest level and ditlerences in change predict- 
able from pretest level Only ihi>se differences which remained would then be attributed lo 
dif ferences among the expernncnial treatments. The best priKedure, therefore, is to 
analyse unpredictable change and ANC OVA provides the besi means of doing this. 

1 here are. however, some serious pri^blems in the use of ANCOVA (tu any method 
*if analysing unpredictable change). Tlie remainder of the paper describes these problems 
and proposals for minimizing their effects. 

Problems with Analysis of Covariance 

In the ANCOVA miidc]. derivations of estimates of parameter values depend upon 
the assumption that the covariate is measi'red without error. The ef fect of any error in 
the covariate is twofold. First, it increases the estimate of the within groups sum of squares 
and thus gives a less powerf ul test of the test of significance of differences among the groups 
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COVARIATE 



<»nU True Covdn^tte ScQfC^ 



\12 



Second, ti icsuliN m M u^kkMC^lunalc oi t'u^ i^lojv oWhc withubgioups lo^iOsMon 
Unc UM poNUCNt NCuiONt> )^M^ paMc^l soMOsiX). Inhe ic^iie.sMon slope loi postiosi woios 
O )on tiuo preiost ^omcm 1 ^ tlw te^iesMon slope toi ob^^encd scores would be: 



b ^ b I ' 



louh.iuncj exteiH ihx lolubiluv o1 i!je pteieM d^^ ) is loss lhan im the legiOsshMi slope 

ilie obseuod scoies uiU bo an uiuleiesiunaie ot the slope unolvnig iho uue pteicsi 
V ovs And n iN ihis Lir.ei slope whkii is .assumed lobelviumn m making vx^vaiuiwe 

.idUi^'^'^KMi N 

Ihe eJtCvi undeiesiinKiung die legiesv.on slope is an undeiadjuslnient oi ^loup 
:ru\in> live p^^s^esl 1 bat is. Uie uiU eltect oi' diUeienees aaiong the -loups .m^ ^he pie^ 
; is mo! K':no\od rins is UluMMied in 1 igiue 1 m uhub the legression sh>pe loi uue 
: si v.. Mosis ! :ubui \Ua\ v^bsei^ed seoies ts oni\ oO. suke ihe pioiest leliabiiiA is 
\ MJ, ILJ live sl.ipc SM nue s.oses been kniuvn ibe posuesi means loi boil^ ^loups 
jld ^v'.-n advisied lo In and il \\^nlld ha\ e been .xmdnded i\u\ liieie \v,is n.^ diMei- 
IvMwcei: »lie iiioupN .Ml ilie pi^Niiesi wlikli ua> noi piedklable liom meiesi dineieiices, 

I Nc Oi ilie uxie^M.^n sl.^pc toi oKseixed s, vnes w iMild iia\e ptodneed adjusted pos{- 
, ^ vA....^:.^ !.-d ih.^ e::-^ne'^us ^onJiM^M) llui: tluMO is aw 



1 , s 



I' P d^/'.r^Me dineuMkc ui ;k^^;;esl SL,Me> \\\\\J\ was .iiinbukible lo JitteunkOs n: 

Adiu^lineiUs to Analysis ot C ovariance 

Iheie .ne essennailx luo .ippjojehe> lo the adjustmeni of ANOOVA pioeodiitos 
k.N.- .K..>iin! -I uniehabihu oMhe ei^v.nuuv These appioaehes ditYei in ilie pomi jt wtneh 
estinuie> oi populanon paiankMois aic deiued, hi one. esnmates of une pietesi oauej. are 
depAcd aikl ANTOV A is peiloimed with them. Un tack the esiunaies themselves need uo\ 
he derived, >i:k. ihe .iliiebi ne .onseqnenees on tlie AN( OVA eomputaiuMis can be deiennm- 
cd and Ihe adn.^nlle^ls^.m be made diieetK upon them. ) In the othei. adjiisimenis to 
\\(X)V A !>M tine v iAanaie scoieseai^ be derived and esiimaies ol these adjustmeuiis obtain- 
ed. 

I mpnieal .ompansons AlcCuw l^H. 107:b) suggest that the former apptoadi 
u ihe snpciioi. Wuh tins appn^adk t!k" esinnate. oi true scores may be obtained luMn eithor 
Mn);Me 'i multiple regiesMon techniques. One readilv available computei progianr (Hall 
dji l^n: » now prt)vjdes ai least t\)r smiple legiession estimates of true scores rather lhan 
..bscr\ed ncoics /or i!ie co\anaie. 

The elYe ' M the adjustments ANTOV A based on estimated true eovariaie scores 
^s ahe! ilie withm jiroupb sums ofsquaies and prv)ducts based on observed scoies ni the 
mannei ^llo^^n in Table 1- The between groups sums oi squaies and products are unaliered. 
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TABLE 1 

With in -groups Sums of Squares and Products with 
Estimates True Covariate Scores 





Simpi« R«gr«s$ion £stin. te 


Multiple R<»or«tftion Estimate 


Sum ol Squ,utv> 
Sum of I'roduciN 


W W 

tt XX XX 

1> XX xy 


n :t .) + r' . 

y^; - xy xx ' ykJ 

" 

w = w 



Estimates of Reliability 

In ihc jdiUNinUMUx summarised in Table 1 an miportur.t variable is i\\c pretest 
leliabihiw I 

XX 

The mi^Nl dppropnaie ej^hmato tor t!io purpose described here is a lest-reiesl re- 
hability . In a ca^c where ihe same test is used tor pretest and posttest. a pooled within^ 
groups correlation between pretest and posttest could serve as the rehabihty eslimute. 

Conclusions and Recommendations 

From the empirical Ci>mparisons reported in McGaw ( W72a) the following con- 
clusii)nsand recommendations can be of fered. 

Identical Pretest and Posttest 

1 . It^ pretest reliability > .80 and prior dif ferences among group means 
< 1 .25 times error variance, ihe observed covariaie isudequaie, 

2. In general, simple regression estimates o! true covariate scores provide 
sufficiently unbiased adjustments for appropriate inferences to be made. 

Non-identical Pretest and Posttest 

1 . Unless prior differences among group means < error variance, observed 
covariate is inadequate, no matter how reliable. 

2- Simple regression estimates of true covariate scores produce underadjusl- 
ment unless prior differences among group means < 1.25 times error 
variance. 

3. In general, multiple regression estimates of true scores provide sufficiently 
unbiased adjustments for appropriate inferences to be made. 
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